Terminal and controlling method thereof

ABSTRACT

A method of controlling a display device can include establishing communication between an external device and the display device to receive screen information displayed on the external device; displaying the screen information displayed in the external device in a first region of a screen of the display device; and when content information in the first region of the screen is moved to a second region of the screen, storing in a storage space corresponding to a format of the content information, the content information, without displaying the content information in the second region.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of co-pending U.S. application Ser.No. 14/831,604, filed on Aug. 20, 2015, which is a Continuation of U.S.application Ser. No. 14/801,628 filed on Jul. 16, 2015 (now U.S. Pat.No. 9,413,820), which is a Continuation co-pending U.S. application Ser.No. 14/543,722, filed on Nov. 17, 2014, which is a Continuation of U.S.patent application Ser. No. 12/545,376 filed on Aug. 21, 2009 (now U.S.Pat. No. 8,914,462), which claims priority under 35 U.S.C. §119(a) toKorean Application Nos. 10-2009-0053946, filed on Jun. 17, 2009,10-2009-0053945, filed on Jun. 17, 2009, 10-2009-0051175, filed on Jun.9, 2009, and 10-2009-0032283, filed on Apr. 14, 2009, all of which arehereby expressly incorporated by reference into the present application.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a terminal, and more particularly, to aterminal and controlling method thereof. Although the present inventionis suitable for a wide scope of applications, it is particularlysuitable for controlling data communication operations between terminals

Discussion of the Related Art

A terminal is a device which may be configured to perform variousfunctions. Examples of such functions include data and voicecommunications, capturing images and video via a camera, recordingaudio, playing music files via a speaker system, and displaying imagesand video on a display. Some terminals include additional functionalitywhich supports game playing, while other terminals are configured asmultimedia players. More recently, terminals have been configured toreceive broadcast and multicast signals which permit viewing of contentsuch as videos and television programs.

The above-described mobile terminal connects a communication such anexternal device having a display unit and an input unit as a notebookcomputer, a personal computer, a PDA and the like and is then able toexchange (transmit and receive) data with the connected external device.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a terminal andcontrolling method thereof that substantially obviate one or moreproblems due to limitations and disadvantages of the related art.

An object of the present invention is to provide a terminal andcontrolling method thereof, by which data of a first terminal isexecutable in a second terminal and by which all functions of the firstterminal are usable using the second terminal.

Another object of the present invention is to provide a terminal andcontrolling method thereof, by which when a wireless communication isconnected between/among a plurality of terminals, content informationcontained on each screen of first and second terminals isinterchangeably usable.

A further object of the present invention is to provide a terminal andcontrolling method thereof, by which a tripartite heterogeneouscommunication function can be provided to first to third terminals usinga short-range communication system and a mobile communication system.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amethod of controlling a terminal according to the present inventionincludes a method of controlling an external terminal from a terminal,the method including establishing communication with the externalterminal; receiving screen information that is displayed in the externalterminal from the external terminal; displaying the screen informationas is displayed in the external terminal on at least a portion of ascreen of the terminal; selecting content information from the screeninformation that is displayed on the at least a portion of the screen ofthe terminal; and transmitting location information of the selectedcontent information displayed on the at least a portion of the screen ofthe terminal to the external terminal. In another aspect of the presentinvention, a terminal includes a wireless communication unit configuredto receive screen information that is displayed in an external terminalby a communication link with the external terminal; a display unitconfigured to display the screen information as is displayed in theexternal terminal on at least a portion of a screen of the terminal; anda control unit, when content information from the screen informationthat is displayed on the at least a portion of the screen is selected,the control unit is configured to transmit location information of theselected content information to the external terminal.

In another aspect of the present invention, a method of controlling aterminal includes displaying screen information including at least onecontent information on a screen of the terminal; establishingcommunication with the external terminal; transmitting the displayedscreen information to the external terminal; and when a signal includinga location information of the at least one content information displayedon a screen of the external terminal is received from the externalterminal, executing a function of the terminal corresponding to the atleast one content information.

In another aspect of the present invention, a terminal includes adisplay unit configured to display screen information including at leastone content information; a communication unit, when communication withan external terminal is established, the communication unit isconfigured to transmit the screen information to the external terminal;and a control unit, when a signal including location information of theat least one content information on a screen of the external terminal isreceived from the external terminal, the control unit is configured toexecute a function of the terminal corresponding to the receivedlocation information on the screen.

In another aspect of the present invention, a method of controlling aterminal includes establishing communication with the plurality ofexternal terminals including a first external terminal and a secondexternal terminal; receiving first screen information displayed on thefirst external terminal and second screen information displayed on thesecond external terminal; displaying the first screen information as isdisplayed in the first external terminal and the second screeninformation as is displayed in the second external terminal on a firstportion and a second portion on a screen of the terminal, respectively;and when content information displayed within the first portion isselected, transmitting the selected content information to the secondexternal terminal. In another aspect of the present invention, aterminal includes a wireless communication unit configured to establishcommunication with a plurality of external terminals including a firstexternal terminal and a second external terminal, the wirelesscommunication unit is further configured to receive a first screeninformation as is displayed on the first external terminal and a secondscreen information as is displayed on the second external terminal; adisplay unit configured to display the first screen information and thesecond screen information on a first portion and a second portion on ascreen of the terminal, respectively; and a control unit, when contentinformation displayed within the first portion is selected, the controlunit is configured to transmit the selected content information to thesecond external terminal. It is to be understood that both the foregoinggeneral description and the following detailed description of thepresent invention are exemplary and explanatory and are intended toprovide further explanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a first terminal of a mobile terminal typeaccording to one embodiment of the present invention;

FIG. 2 is a block diagram of a second terminal of a PC type according toone embodiment of the present invention;

FIG. 3 is a diagram for explaining a remote control system including afirst terminal of a mobile terminal type and a second terminal of a PCtype according to the present invention;

FIG. 4 is a diagram of screen configurations for explaining a processfor a second terminal to control a phonebook menu function of a firstterminal by a wireless communication;

FIG. 5 is a diagram of screen configurations for explaining a processfor a second terminal to control a message menu function of a firstterminal by a wireless communication;

FIG. 6 is a diagram of screen configurations for explaining a processfor a second terminal to control a camera menu function of a firstterminal by a wireless communication;

FIG. 7 is a diagram of screen configurations for explaining a processfor a second terminal to control an image menu function of a firstterminal by a wireless communication;

FIG. 8 is a diagram for explaining an operation control system includinga first terminal of a mobile terminal type and a third terminal of amobile terminal type according to the present invention;

FIG. 9 is a diagram for explaining an operation control system includinga second terminal of a PC type and a third terminal of a mobile terminaltype according to the present invention;

FIG. 10 is a flowchart of a process for a second terminal to access acommunication with a first terminal in an operation control systemaccording to the present invention;

FIG. 11 is a flowchart of a process for a first terminal to access acommunication with a second terminal in an operation control systemaccording to the present invention;

FIG. 12 is a block diagram of a first terminal for screen informationcompression in an operation control system according to a firstembodiment of the present invention;

FIG. 13 is a block diagram of a PC type second terminal fordecompression of compressed screen information in an operation controlsystem according to a first embodiment of the present invention;

FIG. 14 is a flowchart of a process for compressing a video on a screenof a first terminal according to one embodiment of the presentinvention;

FIG. 15 is a flowchart of a process for compressing a video on a screenof a first terminal according to another embodiment of the presentinvention;

FIG. 16 is a flowchart of a process for compressing a video on a screenof a first terminal according to a further embodiment of the presentinvention;

FIG. 17 is a flowchart of a process for decompressing a compressed videoshown in FIG. 14 according to a first embodiment of the presentinvention;

FIG. 18 is a flowchart of a process for decompressing a compressed videoshown in FIG. 15 according to a first embodiment of the presentinvention;

FIG. 19 is a signal processing diagram for a data transceiving processbetween a first terminal and a second terminal in an operation controlsystem according to a second embodiment of the present invention;

FIG. 20 and FIG. 21 are diagrams for screen configurations to explain aprocess for a first terminal to generate first notification informationaccording to a second embodiment of the present invention;

FIG. 22 is a signal processing diagram for a data transceiving processbetween a first terminal and a second terminal according to a thirdembodiment of the present invention;

FIG. 23 and FIG. 24 are diagrams of screen configurations for explaininga process for generating and displaying second notification informationfor a first terminal to announce an event occurrence according to athird embodiment of the present invention;

FIG. 25 is a signal processing diagram for a process for a secondterminal to access homogeneous content information of a first terminalaccording to a fourth embodiment of the present invention;

FIG. 26 is a diagram of a screen configuration of a process for a secondterminal to access homogeneous content information of a first terminalaccording to a fourth embodiment of the present invention;

FIG. 27 is a signal processing diagram for a process for a secondterminal to access heterogeneous content information of a first terminalaccording to a fourth embodiment of the present invention;

FIG. 28 is a diagram of a screen configuration of a process for a secondterminal to access heterogeneous content information of a first terminalaccording to a fourth embodiment of the present invention;

FIG. 29 is a flowchart of a process for a second terminal toautomatically connect a (or establish) communication with a firstterminal using a short-range communication according to a fifthembodiment of the present invention;

FIG. 30 is a diagram of a screen configuration of a process for a secondterminal to set a time period for searching a first terminalperiodically according to a fifth embodiment of the present invention;

FIG. 31 is a diagram of a screen configuration of a process for a secondterminal to reset a time period for searching a first terminalperiodically according to a fifth embodiment of the present invention;

FIG. 32 is a flowchart of a process for a second terminal toautomatically connect a (or establish) communication with a firstterminal using an RFID according to a fifth embodiment of the presentinvention;

FIG. 33 is a diagram of a screen configuration of a process for a secondterminal to automatically connect a (or establish) communication with afirst terminal using an RFID according to a fifth embodiment of thepresent invention;

FIG. 34 is a flowchart of a process for a second terminal to performdisconnection and reconnection operations of communications with a firstterminal according to a sixth embodiment of the present invention;

FIG. 35 is a diagram of a screen configuration of a process for a secondterminal to perform disconnection and reconnection of communicationswith a first terminal according to a sixth embodiment of the presentinvention;

FIG. 36 is a diagram of a screen configuration of a process for a secondterminal to perform disconnection of a communication with a firstterminal according to a sixth embodiment of the present invention;

FIG. 37 and FIG. 38 are diagrams of screen configurations for a processfor a second terminal to inform a user of disconnected and reconnectedstatuses of communications with a first terminal according to a sixthembodiment of the present invention;

FIG. 39 is a flowchart of a process for a first terminal to performdisconnection and reconnection operations of communications with asecond terminal according to a sixth embodiment of the presentinvention;

FIG. 40 is a flowchart of a process for a second terminal to receive,store, edit and execute content information from a first terminalaccording to a seventh embodiment of the present invention;

FIG. 41 is a diagram of a screen configuration for a state that bothscreen information of a second terminal and screen information of afirst terminal are displayed on a screen of the second terminal togetheraccording to a seventh embodiment of the present invention;

FIGS. 42 to 46 are diagrams of screen configurations for a process for asecond terminal to receive and store content information from a firstterminal according to a seventh embodiment of the present invention;

FIG. 47 is a diagram of a screen configuration for a process for asecond terminal to classify and store content information received froma first terminal according to a seventh embodiment of the presentinvention;

FIGS. 48 and 52 are diagrams of screen configurations for a process fora second terminal to execute content information received from a firstterminal according to a seventh embodiment of the present invention;

FIG. 53 is a flowchart of a process for transmitting content informationof a second terminal to a first terminal according to a seventhembodiment of the present invention;

FIG. 54 and FIG. 55 are diagrams of screen configurations of a processfor transmitting content information of a second terminal to a firstterminal according to a seventh embodiment of the present invention;

FIG. 56 is a flowchart of a process for a second terminal to delivercontent information of a first terminal to a third terminal according toan eighth embodiment of the present invention;

FIG. 57 is a diagram of a screen configuration for a state that screeninformation of a second terminal and screen information of first andthird terminals are displayed on a screen of the second terminaltogether according to an eighth embodiment of the present invention;

FIG. 58 is a diagram of a screen configuration for a process for asecond terminal to deliver content information of a first terminal to athird terminal according to an eighth embodiment of the presentinvention;

FIG. 59 is a flowchart of a process for a second terminal to delivercontent information of a third terminal to a first terminal according toan eighth embodiment of the present invention;

FIG. 60 is a diagram of a screen configuration for a process for asecond terminal to deliver content information of a third terminal to afirst terminal according to an eighth embodiment of the presentinvention;

FIG. 61 is a signal processing diagram of a process for performing avoice call among a second terminal, a first terminal and a thirdterminal using different communication systems according to a ninthembodiment of the present invention; and

FIG. 62 is a signal processing diagram of a process for performing avoice call among a second terminal, a first terminal and a thirdterminal using messages and speech according to a ninth embodiment ofthe present invention.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings. It is to be understood by those of ordinary skill in thistechnological field that other embodiments may be utilized, andstructural, electrical, as well as procedural changes may be madewithout departing from the scope of the present invention. Whereverpossible, the same reference numbers will be used throughout thedrawings to refer to the same or like parts.

The suffixes ‘module’ and ‘unit’ for the elements used in the followingdescription are given or used in common by considering facilitation inwriting this disclosure only but fail to have meanings or rolesdiscriminated from each other.

First of all, a mobile terminal described in this disclosure can includesuch a video and audio outputtable terminal as a mobile phone, a smartphone, a digital broadcast terminal, a PDA (personal digitalassistants), a PMP (portable multimedia player), a navigation system, alaptop computer, a personal computer (PC) and the like.

In the following detailed description of the invention, assume a firstterminal and a second terminal are a mobile terminal and a PC,respectively, by which the first and second terminals are non-limited.

A first terminal according to the present invention is explained indetail with reference to FIG. 1 as follows.

FIG. 1 is a block diagram of a first terminal of a mobile terminal typeaccording to one embodiment of the present invention.

Referring to FIG. 1, a first terminal 100 according to the presentinvention is a mobile terminal and includes a communication unit 110, anA/V (audio/video) input unit 120, a user input unit 130, a sensing unit140, an output unit 150, a memory 160, an interface unit 170, acontroller 180, a power supply unit 190 and the like. FIG. 1 shows themobile terminal 100 having various components, but it is understood thatimplementing all of the illustrated components is not a requirement.Greater or fewer components may alternatively be implemented.

In the following description, the above elements of the first terminal100 are explained in sequence.

First of all, the communication unit 110 can include at least one modulewhich permits communication between the first terminal 100 and awireless communication system, between the first terminal 100 and anetwork within which the first terminal 100 is located, or between thefirst terminal 100 and a second terminal 200 according to the presentinvention.

For instance, the communication unit 110 can include a broadcastreceiving module 111, a mobile communication module 112, a wirelessinternet module 113, a short-range communication module 114, aposition-location module 115 and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel.

The mobile communication module 112 transmits/receives wireless signalsto/from one or more network entities (e.g., a base station, an externalterminal, a server, etc.). Such wireless signals may represent a speechcall signal, a video communication call signal and data according totext/multimedia message transceivings.

The mobile communication module 112 is communication-connected to thesecond terminal 200 according to the present invention and is then ableto transmit all data of the first terminal 100 to the second terminal200 under the control of the controller 180. For example, the mobilecommunication module 112 is able to transmit all screen informationdisplayed on the display module 151 to the second terminal 200. And, themobile communication module 112 is able to transmit audio informationoutputted from the audio output module 152 to the second terminal 200.Moreover, the mobile communication module 112 is able to transmit a keysignal inputted from the user input unit 130 or a touch signal inputtedfrom the display module 151 of a touchscreen type to the second terminal200.

The wireless internet module 113 supports Internet access for the firstterminal 100. This module may be internally or externally coupled to thefirst terminal 100. In this case, the wireless Internet technology caninclude WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax(World Interoperability for Microwave Access), HSDPA (High SpeedDownlink Packet Access), etc.

The wireless internet module 113 is connected to the second terminal 200according to the present invention by internet communication and is thenable to transmit all data of the first terminal 100 to the secondterminal 200 under the control of the controller 180. For example, thewireless internet module 113 is able to transmit all screen informationdisplayed on the display module 151 to the second terminal 200. And, thewireless internet module 113 is able to transmit audio informationoutputted from the audio output module 152 to the second terminal 200.Moreover, the wireless internet module 113 is able to transmit a keysignal inputted from the user input unit 130 or a touch signal inputtedfrom the display module 151 of a touchscreen type to the second terminal200.

The short-range communication module 114 facilitates relativelyshort-range communications. Suitable technologies for implementing thismodule include Bluetooth, infrared data association (IrDA),ultra-wideband (UWB), ZigBee, Wi-Fi (wireless fidelity), RFB (remoteframe buffer) and the like.

The short-range communication module 114 is communication-connected tothe second terminal 200 according to the present invention and is thenable to transmit all data of the first terminal 100 to the secondterminal 200 under the control of the controller 180. For example, theshort-range communication module 114 is able to transmit all screeninformation displayed on the display module 151 to the second terminal200. And, the short-range communication module 114 is able to transmitaudio information outputted from the audio output module 152 to thesecond terminal 200. Moreover, the short-range communication module 114is able to transmit a key signal inputted from the user input unit 130or a touch signal inputted from the display module 151 of a touchscreentype to the second terminal 200.

The position-location module 115 identifies or otherwise obtains thelocation of the first terminal 100. If desired, this module may beimplemented with a global positioning system (GPS) module.

Referring to FIG. 1, the audio/video (A/V) input unit 120 is configuredto provide audio or video signal input to the first terminal 100. Asshown, the AN input unit 120 includes a camera 121, a microphone 122 andthe like.

The camera 121 receives and processes image frames of still pictures orvideo, which are obtained by an image sensor in a video call mode or aphotographing mode. And, the processed image frames can be displayed onthe display unit 151.

At least two or more cameras can be provided under the circumstance ofusage. And, the image frame processed by the camera 121 can betransmitted to the second terminal 200 via the communication unit 110.

The microphone 122 receives an external audio signal while the portabledevice is in a particular mode, such as phone call mode, recording modeand voice recognition mode. This audio signal is processed and convertedinto electric audio data.

The processed audio data is transformed into a format transmittable to amobile communication base station via the mobile communication module112 in case of a call mode. The microphone 122 typically includesassorted noise removing algorithms to remove noise generated in thecourse of receiving the external audio signal.

The user input unit 130 generates input data responsive to usermanipulation of an associated input device or devices. Examples of suchdevices include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch, etc.

In this case, a backlight unit is provided under the user input unit 130to generate light for identifying the keypad, the dome switch, the jogwheel and the jog switch in a dark environment.

The sensing unit 140 provides sensing signals for controlling operationsof the first terminal 100 using status measurements of various aspectsof the mobile terminal. For instance, the sensing unit 140 may detect anopen/close status of the first terminal 100, relative positioning ofcomponents (e.g., a display and keypad) of the mobile terminal 100, achange of position of the first terminal 100 or a component of the firstterminal 100, a presence or absence of user contact with the firstterminal 100, orientation or acceleration/deceleration of the firstterminal 100.

Meanwhile, the output unit 150 generates outputs relevant to the sensesof sight, hearing, touch and the like. And, the output unit 150 includesthe display unit (or display module) 151, an audio output module 152, analarm unit 153, a haptic module 154 and the like.

The display module 151 may be implemented using known displaytechnologies including, for example, a liquid crystal display (LCD), athin film transistor-liquid crystal display (TFT-LCD), an organiclight-emitting diode display (OLED), a flexible display and athree-dimensional display. The mobile terminal 100 may include one ormore of such displays.

At least two display units 151 can be provided to the first terminal 100in accordance with the implemented configuration of the first terminal100. For instance, a plurality of display modules can be arranged on asingle face of the first terminal 100 in a manner of being spaced apartfrom each other or being built in one body. Alternatively, a pluralityof display modules can be arranged on different faces of the firstterminal 100.

In case that the display unit 151 and a sensor for detecting a touchaction (hereinafter called ‘touch sensor’) configures a mutual layerstructure (hereinafter called ‘touchscreen’), it is able to use thedisplay unit 151 as an input device as well as an output device. In thiscase, the touch sensor can be configured as a touch film, a touch sheet,a touchpad or the like.

The touch sensor can be configured to convert a pressure applied to aspecific portion of the display unit 151 or a variation of a capacitancegenerated from a specific portion of the display unit 151 to an electricinput signal. Moreover, it is able to configure the touch sensor todetect a pressure of a touch as well as a touched position or size.

The proximity sensor 141 is the sensor that detects a presence ornon-presence of an object approaching a prescribed detecting surface oran object existing around the proximity sensor using an electromagneticfield strength or infrared ray without mechanical contact. Hence, theproximity sensor has durability longer than that of a contact typesensor and also has utility wider than that of the contact type sensor.

The proximity sensor can include one of a transmittive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor and the like.

The audio output module 152 functions in various modes including a callsignal receiving mode, a call mode, a recording mode, a voicerecognition mode, a broadcast reception mode and the like to outputaudio data which is received from the wireless communication unit 110 oris stored in the memory 160.

During operation, the audio output module 152 outputs an audio signalrelated to a particular function (e.g., call received, message received,etc.). The audio output module 152 is often implemented using one ormore speakers, buzzers, other audio producing devices, and combinationsthereof.

The alarm output unit 153 outputs a signal for announcing the occurrenceof a particular event associated with the first terminal 100. Typicalevents include a call received event, a message received event, a keysignal inputted event, and a touch input received event.

The haptic module 154 generates various tactile effects that can besensed by a user. Vibration is a representative one of the tactileeffects generated by the haptic module 154. Strength and pattern of thevibration generated by the haptic module 154 are controllable. Forinstance, different vibrations can be outputted in a manner of beingsynthesized together or can be outputted in sequence.

The memory 160 is generally used to store various types of data tosupport the processing, control, and storage requirements of thecontroller 180. Examples of such data include program instructions forapplications operating on the first terminal 100, phonebook data,message data, audio data, still pictures data, moving pictures data,etc. Moreover, data for various patterns of vibration and/or soundoutputted in case of a touch input to the touchscreen can be stored inthe memory 160.

And, the memory 160 is provided with an operation system (OS) programfor controlling operations of the elements of the first terminal 100.Moreover, the memory 160 is provided with a plurality of applicationsfor running content information executed in the first terminal 100.

For example, the applications can include a word processor, an imageviewer, a video player, an audio player, an internet connector and thelike. The above-described OS program and applications are drivable andexecutable under the control of the controller 180.

Moreover, the above-described OS program and applications can be storedas software in the memory 160 or can be provided as ‘module’ types.

Meanwhile, the interface unit 170 is often implemented to couple thefirst terminal 100 with external devices.

The above-described interface unit 170 may be configured using awired/wireless headset port, an external charger port, a wired/wirelessdata port, a memory card port, a port for coupling to a device having anidentity module, audio input/output ports, video input/output ports, anearphone port, a USB (universal serial bus) port and/or the like.

In particular, the interface unit 170 is wire-connected to the secondterminal 200 via a data cable or the like and is then able to transmitall data of the first terminal 100 to the second terminal 200. Forexample, the interface unit 170 is ale to transmit all screeninformation displayed on the display module 151 to the second terminal200. The interface unit 170 is able to transmit audio informationoutputted from the audio output module 152 to the second terminal 200.And, the interface unit 170 is able to transmit a key signal inputtedfrom the user input unit 130 or a touch signal inputted from the displaymodule 151 of the touchscreen type to the second terminal 200.

Meanwhile, the controller 180 normally controls overall operations ofthe first terminal 100. For instance, the controller 180 performscontrol and processing relevant to a voice call, a data communication, avideo call and the like.

The control operating process of the controller 180 according to anembodiment of the present invention shall be explained in detail later.

A speech text converting unit 181 converts a speech signal inputted fromthe microphone 122 to a text signal or converts a call speech signalreceived from the communication unit 110 to a text signal. Moreover, thespeech text converting unit 181 converts a content of a message receivedfrom the communication unit 110 to a speech signal.

The speech text converting unit 181 can include a TTS (text to speech)module.

And, the first terminal 100 according to the present invention can beprovided with an RFID tag 182 for recording device information of thefirst terminal 100, which is used for the communication connection tothe second terminal 200.

Meanwhile, the power supply unit 190 provides power required by thevarious components for the mobile terminal 100. The power may beinternal power, external power, or combinations thereof.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof.

For a hardware implementation, the embodiments described herein may beimplemented within one or more application specific integrated circuits(ASICs), digital signal processors (DSPs), digital signal processingdevices (DSPDs), programmable logic devices (PLDs), field programmablegate arrays (FPGAs), processors, controllers, micro-controllers,microprocessors, other electronic units designed to perform thefunctions described herein, or a selective combination thereof. Suchembodiments may also be implemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

In the above description, the configurations of the first terminal 100according to the present invention have been explained with reference toFIG. 1.

In the following description, the second terminal 200 according to thepresent invention shall be explained in detail with reference to FIG. 2.

FIG. 2 shows that the second terminal 200 according to the presentinvention is a personal computer (hereinafter abbreviated ‘PC’).Besides, as mentioned in the foregoing description, a stationaryterminal 200 can include every device capable of communicating with thefirst terminal 100, displaying images and outputting audio as well asthe PC.

FIG. 2 is a block diagram of a second terminal of a PC type according toone embodiment of the present invention.

Referring to FIG. 2, a second terminal 200 according to the presentinvention includes a communication unit 210, an input unit 220, a memory230, a speaker 240, a microphone 250, a display unit 260 and acontroller 270.

And, it is understood that the elements (e.g., a camera, an interfaceunit, etc.) mentioned in the foregoing description of the first terminal100 can be additionally loaded in the second terminal 200 in addition tothe above described elements.

The communication unit 210 is communication-connected to the firstterminal 100 according to the present invention under the control of thecontroller 270. And, the communication unit 210 receives screeninformation displayed in the first terminal 100, audio information andkey input information from the first terminal 100.

Like the former communication unit 110 of the first terminal 100 shownin FIG. 1, the above-configured communication unit 210 of the secondterminal 100 can further include a mobile communication module enablingcommunication between the mobile terminal 100 and a stationary terminal200, a wireless internet module and a short-range communication module.

Meanwhile, the input unit 220 generates a key signal for an operationcontrol of the second terminal 200 or a key signal for an operationcontrol of the first terminal 100. Occasionally, the input unit 220 caninclude a keypad, a dome switch, a touch pad (e.g., staticpressure/capacitance), a jog wheel, a jog switch, a mouse, etc.

The memory 230 is able to store a program for an operation of the secondterminal 200. And, various data are stored in the memory 230.

And, the memory 230 is provided with an operation system (OS) programfor controlling operations of the elements of the second terminal 200.Moreover, the memory 230 is provided with a plurality of applicationsfor running content information executed in the second terminal 200. Forexample, the applications can include a word processor, an image viewer,a video player, an audio player, an internet connector and the like. Theabove-described OS program and applications are drivable and executableunder the control of the controller 270.

Moreover, the above-described OS program and applications can be storedas software in the memory 230 or can be provided as ‘module’ types.

The memory 230 may be implemented using any type or combination ofsuitable volatile and non-volatile memory or storage devices includinghard disk, random access memory (RAM), static random access memory(SRAM), electrically erasable programmable read-only memory (EEPROM),erasable programmable read-only memory (EPROM), programmable read-onlymemory (PROM), read-only memory (ROM), magnetic memory, flash memory,magnetic or optical disk, multimedia card micro type memory, card-typememory (e.g., SD memory, XD memory, etc.), or other similar memory ordata storage device.

The speaker 240 outputs data containing audio stored in the memory andvarious audios generated from the second terminal 200. And, themicrophone 250 receives an input of an external audio signal and thenprocesses the input into an electric speech data.

The display unit 260 displays information processed by the secondterminal 200. This display unit 260 may be implemented using knowndisplay technologies including, for example, a liquid crystal display(LCD), a thin film transistor-liquid crystal display (TFT-LCD), anorganic light-emitting diode display (OLED), a flexible display and athree-dimensional display. And, the second terminal 200 may include oneor more of such displays. Moreover, the display unit 260 is coupled to atouch sensor to have a touchscreen type.

The controller 270 controls overall operations of the second terminal200. According to the present invention, the controller 270 displaysscreen information received from the first terminal 100 and transmits akey signal inputted via the input unit 220 to the first terminal 100 viathe communication unit 210.

The speech text converting unit 271 converts a speech signal inputtedfrom the microphone 250 to a text signal or converts a call speechsignal received from the communication unit 210 to a text signal.

Moreover, the speech text converting unit 271 converts a text signalinputted from the touchscreen type display unit 260 or the input unit220 to a speech signal or converts a content of a message received fromthe communication unit 210 to a speech signal.

The above-configured speech text converting unit 181 can include a TTS(text to speech) module.

Besides, the second terminal 200 according to the present inventionincludes an RFID reader 272 configured to read out the data stored inthe former RFID tag 182 provided to the first terminal 100 shown in FIG.1.

If the first terminal 100 is located in the neighborhood of the secondterminal 200, the RFID reader 272 reads or interprets the deviceinformation stored in the RFID tag 182 provided to the first terminal100 and then outputs the read device information to the controller 270.

Once the device information of the first terminal 100 is read via theRFID reader 272, the controller 270 checks whether the read deviceinformation of the first terminal 100 exists on an access authenticationdevice information list stored in the memory 230. If the read deviceinformation on the first terminal 100 exists on the accessauthentication device information list, the controller 270 connects acommunication with the first terminal 100 via the communication unit210.

In the above description, the configurations of the second terminal 200according to the present invention are explained.

In the following description, embodiments relevant to a process fortransmitting and receiving data (e.g., screen information, audioinformation and key input information) between the above configuredfirst and second terminals 100 and 200 are explained with reference tothe accompanying drawings. Optionally, the following embodiments areavailable individually or by being combined together.

FIG. 3 is a diagram for explaining a remote control system including afirst terminal 100 and a second terminal 200 according to the presentinvention.

Referring to FIG. 3, all data (screen information, audio information andkey input information) of the first terminal 100 can be transmitted tothe second terminal 200. In this case, the second terminal 200 is ableto control an operation of the first terminal 100 by wirelesscommunication.

In particular, once the first terminal 100 is wireless-connected to thesecond terminal 200, the first terminal 100 transmits screen informationdisplayed on the display unit 151 to the second terminal 200 so that thescreen information of the first terminal 100 is reproduced on at least aportion of a screen of the second terminal 200.

In this case, the wireless communication can include at least one ofshort-range wireless communications including Bluetooth, infrared dataassociation (IrDA), ultra-wideband (UWB), ZigBee, Wi-Fi (wirelessfidelity), RFB (remote frame buffer), other wired or wireless connectionor wired or wireless communication link and the like.

Meanwhile, the second terminal 200 displays the screen informationreceived from the first terminal 100 on a prescribed portion of itsscreen and is then able to control all menu functions of the firstterminal 100 by wireless (or wired) communication via the input unit 220such as a keypad, a mouse and the like.

In this case, a displayed size of the screen information of the firstterminal 100, which is displayed on the second terminal 200, can be setequal to that of an image actually displayed on the first terminal 100,or set to be different to that of the image actually displayed on thefirst terminal 100.

Once the screen information is received from the first terminal 100, thesecond terminal 200 displays a manipulation unit for enabling a user tomanipulate all functions of the first terminal 100 together with thescreen information. In this case, the manipulation unit can have thesame configuration of a shape of a menu key, a call key, a directionkey, a keypad or the like, which is provided to a main body of the firstterminal 100. For example, the manipulation unit displayed on the secondterminal 200 may be a depiction of the first terminal 100, or at leastdepiction of a screen portion containing the screen information of thefirst terminal 100.

For instance, referring to FIG. 3, the first terminal 100 is a mobileterminal provided with a touchscreen type manipulation unit. Within themanipulation unit of the first terminal 100, the screen information ofthe first terminal 100 and menu execution icons of a phonebook 1, amessage 2, a camera 3 and an image 4 are included, for example.

If so, the second terminal 200 displays the menu execution icons of thephonebook 1, the message 2, the camera 3 and the image 4 within themanipulation unit exactly like those of the first terminal 100.

In the following description, a process for the second terminal 200 tocontrol an operation of the first terminal 100 via the manipulation unitby wireless communication is explained with reference to FIGS. 4 to 7.

FIG. 4 is a diagram of screen configurations for explaining a processfor a second terminal to control a phonebook menu function of a firstterminal by a wireless communication.

Referring to FIG. 4, if the phonebook menu execution icon 1 is selectedfrom the screen shown in FIG. 3 via the input unit 220, the controller270 of the second terminal 200 obtains a location of the selectedphonebook menu execution icon 1 and then transmits a signal fornotifying the obtained location information to the first terminal 100.

For instance, if a screen resolution of the first terminal 100, which isdisplayed on the screen of the second terminal 100, is 600×400 pixelsand a location of the phonebook menu execution icon 1 on the 600×400screen is ‘horizontal 531-534 and vertical 96-100’, the controller 270transmits a signal for notifying the horizontal 531-534 and vertical96-100 corresponding to the location of the phonebook menu executionicon 1 to the first terminal 100.

The controller 180 of the first terminal 100 recognizes the locationinformation contained in the signal received from the second terminal200, executes a phonebook menu existing at the recognized location onthe screen shown in FIG. 3, and displays submenus belonging to thephonebook menu.

Meanwhile, the controller 270 of the second terminal 200 receives thescreen information shown in (a) of FIG. 4 from the first terminal 100and then displays the received screen information. If a menu of ‘1.Search phonebook’ (1a) is selected from the submenus displayed withinthe screen information shown in (a) of FIG. 4 via the input unit 220,the controller 270 of the second terminal 200 transmits a signal fornotifying the location information of the selected menu of ‘1. Searchphonebook’ (1a) to the first terminal 100.

The controller 180 of the first terminal 100 recognizes the locationinformation contained in the signal received from the second terminal200, executes the menu of ‘1. Search phonebook’ (1a) existing at therecognized location on the screen shown in (a) of FIG. 4, and thendisplays a contact information list registered within the phonebook, asshown in (b) of FIG. 4. And, the controller 180 of the first terminal100 transmits the screen information shown in (b) of FIG. 4 to thesecond terminal 200.

Subsequently, the controller 270 of the second terminal 200 receives thescreen information shown in (b) of FIG. 4 from the first terminal 100and then displays the received screen information.

If ‘1. kim’ (1b) is selected from the contact information list displayedwithin the screen information shown in (b) of FIG. 4 via the input unit220 and a call connection key of the ‘1. kim’ (1b) is then selected, thecontroller 270 of the second terminal 200 sequentially transmitslocation information of the selected ‘1. kim’ (1b) and locationinformation of the call connection key to the first terminal 100.

Once the location information of the selected ‘1. kim’ 1b and locationinformation of the call connection key are sequentially received fromthe second terminal 200, the controller 180 of the first terminal 100attempts a call connect to the ‘1. kim’ 1b by controlling thecommunication unit 110, as shown in (c) of FIG. 4 and then transmits thescreen information shown in (c) of FIG. 4 to the second terminal 200.

FIG. 5 is a diagram of screen configurations for explaining a processfor a second terminal to control a message menu function of a firstterminal by a wireless communication.

Referring to FIG. 5, if a user of the second terminal 200 selects amessage menu execution icon 2 within the manipulation unit bymanipulating the input unit 220 such as a mouse, a keypad and the like,the controller 270 transmits location information of the selected menuexecution icon 2 to the first terminal 100.

The controller 180 of the first terminal 100 executes a message menuexisting at the location received from the first terminal 100, as shownin (a) of FIG. 5, and then displays submenus belonging to the messagemenu. Moreover, the controller 180 of the first terminal transmits thescreen information shown in (a) of FIG. 5 to the second terminal 200.

Subsequently, the controller 270 of the second terminal 200 receives thescreen information shown in (a) of FIG. 5 from the first terminal 100and then displays the received screen information. If a menu of ‘1.Transmit message’ 2a is selected from the submenus displayed within thescreen information shown in (a) of FIG. 5 via the input unit 220, thecontroller 270 of the second terminal 200 transmits a displayed locationof the menu of ‘1. Transmit message’ (or ‘message send’) 2a to the firstterminal 100.

The controller 180 of the first terminal 100, as shown in (b) of FIG. 5,executes the menu of ‘1. Transmit message’ 2a at the received locationand then displays a contact information list registered with thephonebook. Moreover, the controller 180 of the first terminal 100transmits the screen information shown in (b) of FIG. 5 to the secondterminal 200.

Subsequently, the controller 270 of the second terminal 200 receives thescreen information shown in (b) of FIG. 5 and then displays the receivedscreen information. If ‘1. kim’ 2b is selected from the contactinformation list displayed within the screen information shown in (b) ofFIG. 5 via the input unit 220, the controller 270 of the second terminal200 transmits location information of the contact information ‘1. kim’2b to the first terminal 100.

If the location information of the contact information ‘1. kim’ 2b isreceived from the second terminal 200, the controller 180 of the firstterminal 100, as shown (c) of FIG. 5, displays a message writing windowand transmits the screen information shown in (c) of FIG. 5 to thesecond terminal 200. In this case, the message writing window caninclude a keypad 2 c for inputting a content of a message and a messagecontent window 2 d on which the content of the message inputted via thekeypad 2 c is displayed.

The controller 270 of the second terminal 200 receives the screeninformation shown in (c) of FIG. 5 from the first terminal 200 and thendisplays the received screen information.

If a plurality of characters is selected from the keypad 2 c via theinput unit 220, the controller 270 of the second terminal 200sequentially transmits location information of the selected charactersto the first terminal 100.

Subsequently, the controller 180 of the first terminal 100 displayscharacters existing at the respective locations, which are beingsequentially received, on the message content window 2 d and transmitsscreen information having the characters reflected on the messagecontent window to the second terminal 200.

The second terminal 200 receives the screen information having theinputted characters reflected on the message content window 2 d from thefirst terminal 100 and then displays the received screen information. Ifa key for sending the message written in the message content window 2 dto the ‘1. kim’ 2b is selected from the input unit 220, the secondterminal 200 transmits location information of the selected key to thefirst terminal 100.

Subsequently, if the location information of the selected key isreceived from the second terminal 200, the controller 180 of the firstterminal 100 sends the message written in the message content window 2 dto the ‘1. kim’ 2b by controlling the communication unit 110 and alsosends the screen information shown in (d) of FIG. 5 to the secondterminal 200.

FIG. 6 is a diagram of screen configurations for explaining a processfor a second terminal to control a camera menu function of a firstterminal by a wireless communication.

Referring to FIG. 6, if a user of the second terminal 200 selects acamera menu execution icon within the manipulation unit by manipulatingthe input unit 220 such as a mouse, a keypad and the like, thecontroller 270 of the second terminal 200 transmits a signal forcommanding a cameral menu execution selected by the user to the firstterminal 100.

In this case, the command signal is the signal containing the locationof the camera menu execution icon 3, as shown in FIG. 4 and FIG. 5, andcommands an action of the first terminal 100 using the locationinformation.

The controller 180 of the first terminal 100 executes the camera menuaccording to the received command signal, as shown in (a) of FIG. 6, andthen displays submenus belonging to the camera menu. Moreover, thecontroller 180 of the first terminal 100 transmits screen informationshown in (a) of FIG. 6 to the second terminal 200.

The controller 270 of the second terminal 200 receives the screeninformation shown in (a) of FIG. 6 from the first terminal 100 and thendisplays the received screen information. If a key signal for capturinga preview picture incident from the camera 121 is inputted via the inputunit 220, the controller 270 of the second terminal 200 transmits asignal for commanding to capture a picture to the first terminal 100.

Subsequently, the controller 180 of the first terminal 100 captures acurrent preview picture incident from the camera 121 according to thereceived command signal, as shown in (c) of FIG. 6, and transmits screeninformation shown in (c) of FIG. 6 to the second terminal 200.

FIG. 7 is a diagram of screen configurations for explaining a processfor a second terminal to control an image menu function of a firstterminal by a wireless communication.

Referring to FIG. 7, if a user of the second terminal 200 selects animage menu execution icon within the manipulation unit by manipulatingthe input unit 220 such as a mouse, a keypad and the like, thecontroller 270 of the second terminal 200 transmits a signal forcommanding an image menu execution selected by the user to the firstterminal 100.

The controller 180 of the first terminal 100 executes the image menuaccording to the received command signal, as shown in (a) of FIG. 7, andthen displays a list of images stored within the image menu. Moreover,the controller 180 of the first terminal 100 transmits screeninformation shown in (a) of FIG. 7 to the second terminal 200.

The controller 270 of the second terminal 200 receives the screeninformation shown in (a) of FIG. 7 from the first terminal 100 and thendisplays the received screen information. If ‘1. a.jpg’ 4a to bedisplayed is selected via the input unit 220, the controller 270 of thesecond terminal 200 transmits a signal for commanding a display of ‘1.a.jpg’ 4a to the first terminal 100.

Subsequently, the controller 180 of the first terminal 100 drives animage display application according to the received command signal andthen displays the ‘1. a.jpg’ on the screen via the driven application,as shown in (b) of FIG. 7. Moreover, the controller 180 of the firstterminal 100 transmits the screen information shown in (b) of FIG. 7 tothe second terminal 200.

In the above description, a process for the second terminal 200 tocontrol an operation of the first terminal 100 is explained in detailwith reference to FIGS. 4 to 7.

Although the above description with reference to FIGS. 4 to 7 relates tothe operation control process for the phonebook menu 1, the message menu2, the camera menu 3 and the image menu 4 of the first terminal 100, itnon-limits various implementations of the present invention. Forinstance, the second terminal 200 is able to control operations of anyand all menu functions, or other icons or buttons of the first terminal100.

An operation control system according to the present invention caninclude the first terminal 100 of a mobile terminal type and the secondterminal 200 of a PC type, as shown in FIGS. 3 to 7, include the firstterminal 100 of a mobile terminal type and a third terminal 300 of amobile terminal type, as shown in FIG. 8, or include the second terminal200 of a PC type and first and third terminals 100 and 300 of aplurality of mobile terminal types, as shown in FIG. 9.

In the following description, a communication access process between thefirst terminal 100 and the second terminal 200 in an operation controlsystem according to the present invention is explained in detail withreference to FIG. 10 and FIG. 11.

FIG. 10 is a flowchart of a process for a second terminal to access acommunication with a first terminal in an operation control systemaccording to the present invention.

Referring to FIG. 10, If the controller 180 of the first terminal 100receives a communication access request signal from the second terminal200 via the communication unit 110 [S11], it checks whether the secondterminal 200 is an accessible device by being authenticated in advance[S12].

In particular, the controller 180 checks whether device information onthe second terminal 200 exists on an access authentication deviceinformation list stored in the memory 160. If the device information onthe second terminal 200 exists on the access authentication deviceinformation list [S13], the controller 180 accesses a communication withthe second terminal by sending a signal for permitting a communicationaccess to the second terminal 200 via the communication unit 110 [S14].

Once the communication is connected to the second terminal 200, thecontroller 180 sends screen information currently displayed on thedisplay unit 151 to the second terminal 200.

Meanwhile, the controller 180 compares the device information receivedfrom the second terminal 200 to the device information corresponding tothe second terminal 200 on the access authentication device informationlist. If the former device information and the latter device informationdiffer from each other, the controller 180 updates the deviceinformation received from the second terminal 200 on the accessauthentication device list [S15].

Yet, as a result of the checking step S12, if the device information ofthe second terminal 200 fails to exist on the access authenticationdevice information list, the controller 180 displays a selection windowfor selecting a presence or non-presence of an access permission of thesecond terminal 200 on the screen of the display unit 151.

If ‘access not permitted’ is selected from the selection window, thecontroller 180 blocks an access of the second terminal 200. If ‘accesspermitted’ is selected from the selection window [S16], the controller180 provides a user with an authentication process for the access of thesecond terminal 200 [S17]. If an authentication for the second terminal200 is permitted by a user [S18], the controller 180 performs actions ofthe steps S14 and S15.

FIG. 11 is a flowchart of a process for a first terminal to access acommunication with a second terminal in an operation control systemaccording to the present invention.

Referring to FIG. 11, if a command for accessing a communication withthe first terminal for a remote control of the first terminal isinputted by a user via the input unit 220, the controller 270 of thesecond terminal 200 searches in the neighborhood for the first terminal100 by controlling the communication unit 210 [S21].

In this case, the controller 270 is able to search in the neighborhoodfor the first terminal 100 using one of various search methods (e.g.,device inquiry of Bluetooth, service discovery, etc.). Alternatively,the controller 270 is able to search for the first terminal 100 usingTCP/IP based SSDP.

As a result of the searching step S21, if the first terminal 100 isfound, the controller 270 checks whether the first terminal 100 is anaccess authenticated device [S22].

If the first terminal 100 is an accessible device [S23], the controller270 transmits a signal for requesting a communication access to thefirst terminal 100 via the communication unit 210 [S24]. If a signal forpermitting the access is received from the first terminal 100 via thecommunication unit [S25], the controller 270 connects the communicationwith the first terminal 100 [S26].

Yet, if the first terminal 100 is the device failing to be authenticatedin the step S22, the controller 270 provides a user with a process forauthenticating the access to the first terminal 100 [S27]. If the userpermits the authentication for the first terminal 100 [S28], thecontroller 270 connects the communication with the first terminal 100.

In the above description, the communication connecting process betweenthe first terminal 100 and the second terminal 200 is explained indetail

In the following description, a process for compressing anddecompressing screen information in a first terminal according to thepresent invention is explained in detail with reference to FIGS. 12 to18.

First of all, an apparatus for compressing screen information of a firstterminal of a mobile terminal type and an apparatus for decompressingthe screen information in an operation control system according to thepresent invention are explained with reference to FIG. 12 as follows.

First Embodiment

FIG. 12 is a block diagram of a first terminal for screen informationcompression in an operation control system according to a firstembodiment of the present invention.

In the following description, the configuration of a first terminal 400may have the same elements of the first terminal 100 shown in FIG. 1 ormay not.

Yet, each of the first terminal 400 shown in FIG. 12 and the formerfirst terminal 100 shown in FIG. 1 basically includes the same device ofthe mobile terminal type and can perform the same operations.

Namely, in the following description of the first embodiment, a processfor compressing screen information using the first terminal 400 shown inFIG. 12 is explained.

Referring to FIG. 12, a first terminal 400 for implementing an operationcontrol system includes an exterior configuration 410, an internalhardware 430, an application 450, a virtual server 470, a controller(this is the same of the controller 180 shown in FIG. 1, hereinafterindicated by a reference number 180), and the like.

The exterior configuration 410 of the first terminal 400 includes an LCD411, a speaker 412, a microphone 413, a keypad/touchpad 414, a networkdevice 415 and the like.

The internal hardware 430 includes a display module 431, a video memory432, an audio module 433, an audio output memory 434, an audio inputmemory 435, an input device module 436, a wire/wireless network module437, and the like. In this case, the video memory 432 stores and outputsvideo information on a screen of the first terminal 400. Thewire/wireless network module 437 is connected to an external networkdevice 415 and then transmits compressed and encoded video informationto a second terminal 500.

The application 450 is implemented using software and includes anOS/device driver 451, a video output unit 452, an audio output unit 453,an audio input unit 454, an input processing unit 455 and the like.

The virtual server 470 is implemented using software and includes aserver video capture and encoding unit 471, a server audio capture andencoding unit 472, a sever audio decoding unit 473, a server inputdevice information unit 474, a server protocol 475 and the like.

The server video capture and encoding unit 471 of the virtual server 470receives an input of video information on a screen of the first terminal400 from the video memory 432 and then extracts low frequencyinformation and middle frequency information from the inputted videoinformation.

The server video capture and encoding unit 471 determines a variationextent of current screen information by comparing low frequency andmiddle frequency information of current video information to lowfrequency and middle frequency information of previous videoinformation, respectively. The server video capture and encoding unit471 determines the current video information as ‘total variation’,‘partial variation’ or ‘no variation’ according to the variation extent.

If the current video information is determined as ‘total variation’, theserver video capture and encoding unit 471 respectively quantizes thelow frequency information and the middle frequency information of thecurrent video information.

If the current video information is determined as ‘partial variation’,the server video capture and encoding unit 471 respectively quantizesthe low frequency information and the middle frequency information ofthe current video information and then generates information indicatinga difference from the former low frequency information of the previousvideo information and information indicating a difference from theformer middle frequency information of the previous video information.

If the current video information is determined as ‘no variation’, theserver video capture and encoding unit 471 extracts high frequencyinformation from the current video information and then quantizes theextracted high frequency information. The server video capture andencoding unit 471 then performs entropy encoding on the compressed videoinformation.

If the current video information is determined as ‘no variation’, theserver video capture and encoding unit 471 quantizes the middlefrequency information of the current video information and thengenerates difference information indicating a difference between thequantized middle frequency information and the former middle frequencyinformation in ‘total variation’ or ‘partial variation’. In this case,the quantization of the middle frequency information in ‘no variation’has resolution higher than that of the middle frequency information in‘total variation’ or ‘partial variation’.

In doing so, in case of determining the variation extent of the currentvideo information, the server video capture and encoding unit 471calculates the number of pixels, of which variation betweencorresponding pixels is equal to or greater than a threshold, or a ratioof this number.

If the server video capture and encoding unit 471 determines the currentscreen information as ‘no variation’, it is able to further perform astep of sampling a predetermined number of pixels in current videoinformation.

In doing so, the pixels sampled by the server video capture and encodingunit 471 are compared to the pixels sampled in the previous videoinformation. In this case, if a difference between the correspondingpixels has the pixel number equal to or greater than a prescribedthreshold or the number ratio is equal to or greater than a prescribedratio, the current video information is re-determined as ‘partialvariation’. And, a process corresponding to ‘partial variation’ isperformed.

The controller 180 compresses, encodes and outputs the video informationof the first terminal 400 by controlling the video output unit 452 ofthe application and the server video capture and encoding unit 471 ofthe virtual server 450. In this case, an identifier corresponding to‘total variation’, ‘partial variation’ or ‘no variation’ is attached tothe outputted compressed video information. For instance, thisidentifier can be set to 0, 1 or 2.

In the configuration of the first terminal 400 to implement theoperation control system, the exterior configuration 410 is connected toeach of correspondent elements of the internal hardware 430. Each of theelements of the internal hardware 430 is controlled by the application450. And, the virtual server 470 is connected to the application 450 andthe hardware 430 to transceive data or commands.

FIG. 13 is a block diagram of a PC type second terminal fordecompression of compressed screen information in an operation controlsystem according to a first embodiment of the present invention.

Referring to FIG. 13, a virtual client 550 includes elements thatdisplay video information received from the first terminal 400 via awire/wireless network device 515. In this case, the elements include aclient protocol 559, a client video decoding unit 555, a client audiodecoding unit 556, a client audio capture and encoding unit 557, aclient input device information unit 558 and the like, which areconnected to an OS and hardware of a second terminal 500 via a clientvideo output unit 551, a client audio output unit 552, a client audioinput unit 553, a client input processing unit 554 and the like,respectively.

The virtual client 550 is connected to a video output device 511, anaudio output device 512, an audio input device 513, a keyboard/mouse 514and the like of the second terminal 500.

The client video decoding unit 555 shown in FIG. 13 decodes anddecompresses the video information compressed and encoded by the servervideo capture and encoding unit 471 shown in FIG. 12. The decompressionof the compressed video information follows a process reverse to theformer process for compressing the video information.

The client video decoding unit 555 performs entropy decoding on thereceived compressed video information and then determines whether thevideo information is unique video information, differential videoinformation or image quality recovery video information using anidentifier contained in the compressed video information.

In case of determining the received video information as the uniquevideo information using the identifier, the client video decoding unit555 dequantizes low frequency information and middle frequencyinformation of the unique video information and then synthesizes thedequantized low frequency information and the dequantized middlefrequency information together. This synthesized video does not containhigh frequency information and can be interpolated to output smoothreconstructed video information.

In case of determining the received video information as thedifferential video information using the identifier, the client videodecoding unit 555 generates quantized low and middle frequencyinformation from adding different information of the low and middlefrequency information and the previous video information together andthen dequantizes the low and middle frequency information. Thedequantized low and middle frequency information are then synthesizedtogether. In case of the differential video information, high frequencyinformation is not contained in the synthesized video. Therefore,interpolation is preferably performed.

In case of determining the received video information as the imagequality recovery video information using the identifier, the clientvideo decoding unit 555 dequantizes high frequency information and thensynthesizes the dequantized high frequency information with thereconstructed low and middle frequency information. Since thesynthesized video in the process for reconstructing the image qualityrecovered vide information entirely contains the low frequencyinformation, the middle frequency information and the high frequencyinformation, it is unnecessary to perform the interpolation.

The video information decompressed by the client video decoding unit 555is forwarded to the video output unit 251 and is then displayed on thevideo output device 511 of the second terminal 500.

The client video decoding unit 555 reconstructs high-resolutionintermediate information from high-resolution middle frequencyinformation generated from the compression process.

In this case, the reconstruction of the high-resolution middle frequencyinformation can be expressed as Q4 (M)=Q4 (Q2⁻¹ (Q2(M)))+X(M). In thiscase, Q2⁻¹ (Q2(M)) refers to the result from processing the unique videoinformation or the differential video information that is used. Thereconstructed high-resolution intermediate information is synthesizedwith the reconstructed high frequency information and the like.

The operation control system according to the present invention, asshown in FIG. 12 and FIG. 13, is implemented by the combination ofhardware and software. In particular, the operation control system isrealized by the virtual server 470 loaded in the first terminal 400 andthe virtual client 550 loaded in the second terminal 500.

The virtual server 470 and the virtual client 550 are connected to eachother by the network device 415 of the first terminal 400 and thewire/wireless network device 515 of the second terminal 500 bywire/wireless connection. According to this connection, the virtualserver 470 compresses the video information on the screen of the firstterminal 400 and then transmits the compressed video information to thevirtual client 550 of the second terminal 500. Subsequently, the virtualclient 550 delivers the video information received from the firstterminal 400 to the video output device 511 by real time so that thedelivered video information can be displayed on the video output device511.

FIG. 14 shows one embodiment for video compression of the first terminal400, which is performed by the server video capture and encoding unit471 of the virtual server 470.

Referring to FIG. 14, a video compression of the first terminal 100according to one embodiment of the present invention includes a step ofextracting low frequency information and middle frequency information, avideo information variation analyzing step of determining a variationextent of current video information by comparing the current videoinformation to previous video information based on the extracted low andmiddle frequency information, a step of generating unique videoinformation, differential video information or image quality recoveryvideo information by differentiating a presence of non-presence ofinformation on a difference from a quantization target according to thevariation extent of the current video information, and a step ofencoding each of the generated video information. The video compressionof the first terminal 400 according to one embodiment is explained indetail with reference to FIG. 14 as follows.

First of all, a step S31 is the step of extracting low frequencyinformation and middle frequency information from video information. Avideo of the first terminal is inputted as consecutive video information(e.g., frames).

For this extraction, the inputted video information is resolved into lowfrequency (L) information and intermediate frequency (M) information.When the video information is resolved into the low frequencyinformation and the middle frequency information, wavelet transform isused. Preferably, for low operation amount, Harr wavelet is used. Inthis step, high frequency (H) information does not need to be extractedfrom the corresponding video information. This is because a user of thefirst terminal may not attempt to read letters if such a video variationas animation/scroll and the like is severe.

In the step S31, since the low frequency information and the middlefrequency information has relatively low spatial resolution, the uniquevideo information is reduced. Since the low frequency information andthe middle frequency information are extracted from the videoinformation, a compression ratio is high. The step S31 performs aninteger addition/subtraction operation only or performs an integeraddition/subtraction operation and a logical operation only.

A step S32 is the step of analyzing a variation extent of current videoinformation compared to previous video information. In this step, lowfrequency information and middle frequency information of previous videoinformation are compared to low frequency information and middlefrequency information of current video information, respectively.

First of all, low frequency information is compared. A threshold forevaluating a variation extent between a pixel corresponding to lowfrequency information of previous video information and a pixelcorresponding to low frequency information of current video informationis preferentially determined. This threshold refers to an extent forrecognizing that there is a variation. And, the threshold can be variousselectable as 10%, 20%, 30%, 50%, etc. The number of pixels having thevariation equal to or greater than the threshold between pixels is thencalculated.

Subsequently, middle frequency information is compared. It is analyzeswhether a variation extent between a pixel corresponding to middlefrequency information of previous video information and a pixelcorresponding to middle frequency information of current videoinformation deviates from the threshold. And, the number of pixelsdeviating from the threshold is calculated.

In this case, a variation threshold of low frequency information isapplicable to the threshold. And, a threshold can be differently set byconsidering a characteristic of the middle frequency information.

The number of pixels deviating from the threshold range for the lowfrequency information and the number of pixels deviating from thethreshold range for the middle frequency information are added together.

In this case, according to how much a ratio is occupied in the totalpixel number by the added number of pixels, the current videoinformation can be determined as ‘total variation’, ‘partial variation’or ‘no variation’.

For instance, if the ratio of the number of pixels recognizable ashaving variations is equal to or greater than 50%, it is determined thatthe current video information has a considerable video variation bybeing compared to the previous video information. And, the variationextent of the current video information is determined as ‘totalvariation’. If the ratio of the number of pixels recognizable as havingvariations is 5%˜50%, it is determined that the current videoinformation has a partial video variation. And, the variation extent ofthe current video information is determined as ‘partial variation’.

If the ratio of the number of pixels recognizable as having variationsis smaller than 5%, it is determined that the current video informationhas no video variation by being compared to the previous videoinformation. And, the variation extent of the current video informationis determined as ‘no variation’.

In this case, although the determination references of the number ratioare set to 50% and 5%, it is able to variously set the number ratiodetermination references to 70% and 10% or 50% and 0%, or the like.Instead of using the number ratio, it is able to use the numbers of 10,20, 30 and the like as the determination references.

A step S33 is the step of generating unique video information byrespectively quantizing low frequency information and middle frequencyinformation if the current video information is determined as ‘totalvariation’. In this case, the unique video information refers to thevideo information that contains original video information intact.Specifically, the unique video information is the video informationresulting from eliminating high frequency information from originalvideo information.

In this case, since low frequency information contains most importantinformation, quantization for the low frequency information has highestresolution. Quantization for the intermediate information has resolutionlower than that of the low frequency information.

Steps S34 and S35 are the step of if the current video information isdetermined as ‘partial variation’, quantizing the low frequencyinformation and the middle frequency information of the current videoinformation (Q1(L), Q2(M)), respectively and the step of generatingdifferential video information by comparing the quantized low frequencyinformation and the quantized middle frequency information of thecurrent video information to quantization results of low frequencyinformation and middle frequency information of the previous videoinformation, respectively.

In this case, the differential video information refers to the videoinformation generated from difference information between the currentvideo information and the previous video information in the lowfrequency information and the middle frequency information.

As can be observed from the step S35, the difference information in thelow frequency information and the difference information in the middlefrequency information can be expressed as D(L)=Q1(L)−Q1(L′) andD(M)=Q2(M)−Q2(M′), respectively. In this case, the D(L) indicates thedifference information on the low frequency information and the D(M)indicates the difference information on the middle frequencyinformation. The Q1(L) indicates a result from quantizing the lowfrequency information of the current video information. The Q1(M)indicates a result from quantizing the middle frequency information ofthe current video information. The Q1(L′) indicates a result fromquantizing the low frequency information of the previous videoinformation. And, the Q1(M′) indicates a result from quantizing themiddle frequency information of the previous video information.

In the step S35, quantization resolution of the low and middle frequencyinformation is maintained equal to that of the low and middle frequencyinformation in case of being determined as ‘total variation’.

By finding the difference information in the steps S34 and S35, avarying part is left as a meaningful value only. As a result, aconsiderable amount of data (non-varying part) is compressed in anencoding process.

Steps S36 and S37 are the step of extracting high frequency informationfrom the current video information if the current video information isdetermined as ‘no variation’ and the step of generating image qualityrecovery video information by quantizing (Q3(H)) the extracted highfrequency information.

The image quality recovery video information contains additionalinformation for the image quality recovery only because the lowfrequency information and the middle frequency information weredelivered in the previous step. By the image quality recovery videoinformation, an image quality can be enhanced well enough to identify asmall letter.

Thus, the method of transmitting high frequency information is takenonly if there is no video variation. This is because a user of the firstterminal is not inconvenient to read letters when a video variationstops. In particular, this is the result in considering a user's habitin using the first terminal.

In this case, although the high frequency information has high spatialresolution, its value is almost 0. Hence, considerable compressionoccurs in the course of entropy encoding. Moreover, since the highfrequency information is a region insensitive to the eyes, aquantization process for lowest resolution is performed thereon.

The unique video information, the differential video information and theimage quality recovery video information generated from the steps S33 toS37 are entropy-encoded in a step S50. And, such an identifier as 0, 1,2 and the like is given to each of the video information.

The identifiers are transmitted to the virtual client of the secondterminal by being respectively contained in the unique videoinformation, the differential video information and the image qualityrecovery video information. If the compressed unique video information,differential video information and image quality recovery videoinformation are decompressed by the virtual client 50 of the secondterminal, a type of the transmitted video information can be identifiedby the corresponding identifier.

FIG. 15 shows another embodiment of a first terminal video compression.

Referring to FIG. 15, in the first terminal video compression accordingto another embodiment performed by the server video capture and encodingunit 471 of the virtual server 470, the steps S38 and S39 in case ofdetermining the current video information as ‘no variation’ in FIG. 14are further included.

The step S38 is the step of quantizing (Q4(M))) middle frequencyinformation with quantization resolution higher than that of the middlefrequency information of ‘total variation’ or ‘partial variation’. Inparticular, the step S38 further enhances an image quality of the middlefrequency information.

The quantization result of the step S38 is sent to the encoding stepafter the difference information and the quantization result of themiddle frequency information of the ‘total variation’ or the ‘partialvariation’ have been generated.

As can be observed from the formula of ‘X(M)=Q4(M)−Q4(Q2⁻¹ (Q2(M)))’ inthe step S39, the high-resolution middle frequency differenceinformation is generated in a manner of dequantizing the result ofquantizing the middle frequency information with high resolution and theresult of quantization of the middle frequency information of the ‘totalvariation’ or the ‘partial variation’ and a difference of a result fromquantizing it with high resolution.

The step S39 is the process for further compressing the quantized resultin the step S38.

FIG. 16 shows a first terminal video compression according to a furtherembodiment of the present invention.

Referring to FIG. 16, in the first terminal video compression accordingto a further embodiment performed by the server video capture andencoding unit 471 of the virtual server 470, the steps S40 and S41 incase of determining the current video information as ‘no variation’ inFIG. 14 and FIG. 15 are further included.

In FIG. 16, if current video information is determined as ‘novariation’, it is determined again whether the current video informationmay be determined as ‘partial information’.

In the step S40, a prescribed number of pixels corresponding to eachother among pixels of current and previous video information aresampled. In this case, the number of sampled pixels is determined inconsideration of operation capability of the first terminal. Forinstance, 9, 12, 15, 16 or 20 pixels can be variously determined foreach video information.

In the step S41, pixels sampled in the current video information arecompared to pixels sampled in the previous video information. In thiscase, the number of pixels exceeding a threshold between the pixelssampled in the current video information and the pixels sampled in theprevious video information is equal to or greater than a prescribednumber or a prescribed ratio, the current video information isre-determined as ‘partial variation’.

In this case, the prescribed number of the comparison reference can beset to 1. And, the prescribed ratio can be variously set to 3%, 5%, 10%or the like. If it is determined as ‘partial variation’ in this step,the step S34 is performed. If it is still determined as ‘no variation’,the step S36 or S38 is performed.

In the following description, a process for decompressing a compressedvideo received from the first terminal by the virtual client of thesecond terminal is explained with reference to FIG. 17 and FIG. 18.

Embodiments shown in FIG. 17 and FIG. 18 correspond to a process reverseto that shown in FIG. 14 and FIG. 15. Without detailed explanation, thedecompression process shown in FIG. 14 and FIG. 15 is apparent to thoseskilled in the art, who understand the compression process.

FIG. 17 shows one embodiment for decompressing the compressed videoshown in FIG. 14. In particular, the embodiment shown in FIG. 17 isperformed by the client video decoding unit 555 of the virtual client550 of the second terminal.

Referring to FIG. 17, compressed data is entropy-decoded in a step S61.Subsequently, in a step S62, whether video information received from thefirst terminal is unique video information, differential videoinformation or image quality recovery video information is determinedusing an identifier included in each of the video information.

First of all, a case in which the received video information isdetermined as the unique video information in the step S62, quantizedlow and middle frequency information of the unique video information aredequantized in a step S63.

Subsequently, in a step S64, the dequantized low frequency informationand the dequantized middle frequency information are synthesizedtogether. Since the synthesized video does not contain high frequencyinformation, interpolation can be performed like a step S65. As a resultof this interpolation, it is able to output smoother reconstructed videoinformation.

If the received video information is determined as the differentialvideo information in the step S62, quantized low frequency informationand quantized middle frequency information are generated from addingdifferences of the low and middle frequency information to the previousvideo information in a step S66.

In a step S67, the low frequency information and the middle frequencyinformation are dequantized. Subsequently, in a step S68, thedequantized low frequency information and the dequantized middlefrequency information are synthesized together. Since high frequencyinformation is not contained in the synthesized video in case of thedifferential video information, it is able to perform interpolation likea step S69.

If the received video information is determined as the image qualityrecovery video information in the step S62, quantized high frequencyinformation is dequantized in a step S70. Subsequently, in a step S71,the dequantized high frequency information and the already-reconstructedlow and middle frequency information are synthesized together. Thus, asthe process for reconstructing the image quality recovery videoinformation includes the low, middle and high frequency information, itis unnecessary to perform the interpolation.

Finally, the reconstructed video information processed in each of theabove-described cases is sent to the video output unit 551 in a stepS80.

FIG. 18 shows another embodiment for decompressing the compressed videoshown in FIG. 15.

In FIG. 18, a process for reconstructing high resolution middlefrequency information from the high resolution middle frequencydifference information generated from the compressing process shown inFIG. 15 is further included.

Referring to FIG. 18, a quantization result of the high-resolutionmiddle frequency is reconstructed by the formula of‘Q4(M)=Q4(Q2⁻¹(Q2(M)))+X(M)’ in the step S72.

In this case, Q2⁻¹(Q2(M)) uses a processing result of the unique videoinformation or the differential video information. Subsequently, thehigh resolution middle frequency quantization result is dequantized in astep S73 to reconstruct the high resolution middle frequencyinformation.

Thus, the video compression and decompression process of the first andsecond terminals according to the first embodiment of the presentinvention is explained in detail.

In the following description, a data transmitting and receivingoperation process and a communication connecting operation processbetween a first terminal and a second terminal in an operation controlsystem according to embodiments of the present invention are explainedin details.

Second Embodiment

According to a second embodiment of the present invention, when screeninformation of a first terminal is displayed on a second terminal,content information contained in the screen information of the firstterminal can be easily recognized in the second terminal. And, thecontent information of the first terminal can be freely used and editedin the second terminal.

In the following description of the first to third embodiments of thepresent invention, assume that the first terminal of a mobile terminaltype and the second terminal of a PC type are used.

Of course, the above assumption is made to clarify the description ofthe first to third embodiments of the present invention. Alternatively,each of the first and second terminals according to the first to thirdembodiments of the present invention can have a mobile terminal type.Alternatively, each of the first and second terminals according to thefirst to third embodiments of the present invention can include astationary terminal.

Therefore, the first and second terminals according to the first tothird embodiments of the present invention can include terminals capableof communication by including a screen display device and an inputdevice.

A first embodiment of the present invention is explained in detail withreference to FIG. 19 as follows.

FIG. 19 is a signal processing diagram for a data transceiving processbetween a first terminal 100 and a second terminal 200 in an operationcontrol system according to a first embodiment of the present invention.

Referring to FIG. 19, the controller 180 of the first terminal 100checks whether at least one content information exists within screeninformation to be initially displayed on the display unit 151 [S111].

In this case, the at least one content information can include a text,an image, a received message, contact information within a phonebook, anaudio file, a photo file, a video file, a game file, scheduleinformation, a document file, an electronic dictionary file, acalculator file, webpage address information and the like.

In particular, the content information includes all data existing withina menu function of the first terminal 100. And, the contact informationcan include a mobile phone number, name, home phone number and emailaddress of a correspondent party, etc.

In this case, if the at least one content information exists within thescreen information to be displayed [S112], the controller 180 generatesfirst notification information announcing the content information viathe screen information [S113]. And, the controller 180 transmits thegenerated first notification information to the second terminal 200 viathe communication unit 110 by having the generated first notificationinformation included in the screen information to display [S114].

In this case, the first notification information may be generated inform of a text indicating the content information, a 2- or 3-dimensionalimage, an icon, an animation, a watermark, a barcode or the like.

In this case, the controller 180 transmits the screen informationcontaining the first notification information to the second terminal 200by compressing the screen information by the processes shown in FIGS. 14to 16.

In particular, the controller 180 is able to compress the screeninformation containing the first notification information therein usinga video or still picture compression scheme. For example, the screeninformation can be compressed using such a video compression scheme asJPEG, PNP, MPEG, H.264, etc.

Moreover, in case of transmitting audio information outputted from theaudio output module 152 to the stationary terminal 200, the controller180 is able to compress the audio information using an audio compressionscheme. For example, the audio information can be compressed using suchan audio compression scheme as MP3, MP4, SBC, ADPCM, Ogg Vorbis, etc.

In case of transmitting screen information containing first notificationinformation compressed by the above process to the second terminal 200,the controller 180 is able to transmit the screen information using aVDP standard protocol (video) and A2DP standard protocol (audio) ofBluetooth.

A first notification information generating process and a firstnotification information transmitting process in the controller 180 areexplained in detail with reference to FIG. 20 and FIG. 21 as follows.

FIG. 20 and FIG. 21 are diagrams for screen configurations to explain aprocess for a first terminal to generate first notification informationaccording to a second embodiment of the present invention.

Referring to (a) of FIG. 20, if schedule content information existswithin a screen to display, the controller 180 of the mobile terminal100 generates text type first notification information 10 a notifyingthe schedule content information 10, as shown in (b) of FIG. 13. thecontroller 180 is then able to transmit the text type first notificationinformation 10 a to the second terminal 200 by having the text typefirst notification information included in the screen information todisplay.

In (b) of FIG. 20, shown is the screen information containing the texttype first notification information 10 a received by the second terminal200 from the first terminal 100 that is displayed.

In this case, the controller 180 of the first terminal is able totransmit the first notification information 10 a in a manner ofsynthesizing or overlapping the first notification information 10 aaround a region on which the schedule information 10 is displayed.

Alternatively, instead of displaying the schedule information 10, thecontroller 180 of the first terminal 100 is able to transmit the firstnotification information 10 a in a manner to synthesize or overlap thefirst notification information 10 a with a region where the scheduleinformation 10 is located only.

Alternatively, the controller 180 of the first terminal 100 is able totransmit the first notification information 10 a in a manner tosynthesize or overlap the first notification information 10 a within anindicator region of the screen information.

Alternatively, the controller 180 of the first terminal 100, as shown in(c) of FIG. 20, generates an icon type first notification information 10b notifying the schedule information 10 and is then able to transmit thegenerated icon type first notification information 10 b to the secondterminal 200 by having the icon type first notification information 10 bincluded in the screen information to display.

In this case, in (c) of FIG. 20, shown is the screen information, inwhich the icon type first notification information 10 b received fromthe first terminal 100 by the second terminal 200 is included, that isdisplayed.

The controller 180 of the first terminal 100 generates firstnotification information 10 c notifying the schedule information 10 as abarcode type, as shown in (d) of FIG. 20, and is then able to transmitthe generated barcode type first notification information 10 c to thesecond terminal 200 by having it included in the screen information.

Referring to (a) of FIG. 21, if webpage address content information 20exists within a screen to display, the controller 180 of the firstterminal 100 generates text type first notification information 20 anotifying the webpage address content information 20, as shown in (b) ofFIG. 21, and is then able to transmit the text type second notificationinformation 20 a to the second terminal 200 by having it included in thescreen information to display.

In (b) of FIG. 21, shown is the screen information containing the texttype first notification information 20 a received by the second terminal200 from the first terminal 100 that is displayed.

In this case, the controller 180 of the first terminal is able totransmit the first notification information 20 a in a manner tosynthesize or overlap the first notification information 20 a around aregion on which the webpage address content information 20 is displayed.

Alternatively, instead of displaying the webpage address contentinformation 20, the controller 180 of the first terminal 100 is able totransmit the first notification information 20 a in a manner tosynthesize or overlap the first notification information 20 a with aregion where the webpage address content information 20 is located only.

Alternatively, the controller 180 of the first terminal 100 is able totransmit the first notification information 20 a in a manner tosynthesize or overlap the first notification information 20 a within anindicator region of the screen to display.

Alternatively, the controller 180 of the first terminal 100, as shown in(c) of FIG. 21, generates icon type first notification information 20 bnotifying the webpage address content information 20 and is then able totransmit the generated icon type first notification information 20 b tothe second terminal 200 by having the icon type first notificationinformation 20 b included in the screen information to display.

The controller 180 of the first terminal 100 generates firstnotification information 20 c notifying the webpage address contentinformation 20 as a barcode type, as shown in (d) of FIG. 21, and isthen able to transmit the generated barcode type first notificationinformation 20 c to the second terminal 200 by having it included in thescreen information to display.

Meanwhile, referring back to FIG. 19, if the screen informationcontaining the first notification information is received from the firstterminal 100 via the communication unit 210, the controller 270 of thesecond terminal 200 displays the received screen information on thedisplay unit 260 [S115].

In particular, the controller 270 of the second terminal 200 decodes thescreen information containing the first notification information by theabove described process shown in FIG. 17 or FIG. 18, and is then able todisplay the decoded screen information on the display unit 260.

Namely, the controller 270 of the second terminal 200 is able todecompress the compression of the received screen information using avideo or still picture decoding scheme.

The compression of the screen information can be decompressed using sucha video decoding scheme as JPEG, PNP, MPEG, H.264 and the like. Thedecompressed screen information can be displayed on the display unit260.

In case of receiving audio information from the first terminal 100, thecontroller 270 of the second terminal 200 is able to decompress thecompression of the received audio information using an audio decodingscheme.

The compression of the audio information is decompressed using such anaudio decompression scheme as MP3, MP4, SBC, ADPCM, Ogg Vorbis and thelike. The decompressed audio information is outputted to the speaker 240and the decompressed screen information is displayed on the display unit260.

In this case, if the first notification information is selected from thescreen information via the input unit 220 or the touchscreen typedisplay unit 260 [S116], the controller 270 of the second terminal 200executes a function of the content information corresponding to thefirst notification information [S117].

In the following description, a process for the controller 270 of thesecond terminal 200 to execute a function of content informationcorresponding to first notification information is explained in detail.

First of all, if the first notification information is selected from thescreen, the controller 270 of the second terminal 200 generates a signalfor requesting an execution of a content corresponding to the firstnotification information and then transmits the generated request signalto the communication unit 11 of the first terminal 100 via thecommunication unit 210.

In the content execution request signal, information indicating adisplay location of the first notification information selected on thescreen information can be included. In particular, the controller 270obtains the display location of the selected notification information onthe screen information and is then able to transmit the request signalincluding the obtained display location information of the firstnotification information to the first terminal 100.

In case of receiving the request signal via the communication unit 110,the controller 180 of the first terminal 100 executes contentinformation corresponding to the first notification information bydriving an application and then transmits execution screen informationof the content information to the second terminal 200 via thecommunication unit 110.

In particular, the controller 180 obtains the location information ofthe first notification information included in the received requestsignal. If the first notification information exists at the obtainedlocation on a current screen, the controller 180 executes the contentinformation corresponding to the first notification information and isthen able to transmit the execution screen information of the contentinformation to the second terminal 200.

In case of receiving the execution screen information of the contentinformation from the first terminal 100, the controller 270 of thesecond terminal 200 displays the received execution screen informationon the screen of the display unit 260.

For instance, if the barcode type first notification information 10 cshown in (d) of FIG. 20 is selected in the second terminal 200, thefirst terminal 100 searches the memory 160 for a schedule correspondingto the first notification information 10 c, executes it on the screen ofthe display unit 151, and then transmits the schedule screen to thesecond terminal 200.

Moreover, if the icon type first notification information 20 b shown in(c) of FIG. 21 is selected in the second terminal 200, the firstterminal 100 accesses a webpage corresponding to the first notificationinformation 20 b and then transmits the accessed webpage screen to thesecond terminal 200.

Meanwhile, in case of receiving the request signal via the communicationunit 110, the controller 180 of the first terminal 100 does not executethe content information corresponding to the first notificationinformation on the screen of the display unit 151 but is able todirectly transmit a content file corresponding to the first notificationinformation to the second terminal 200.

Moreover, while screen information containing the first notificationinformation is displayed on the display unit 151, if the firstnotification information is selected by a user, the controller 180 ofthe first terminal 100 is able to transmit a content file correspondingto the first notification information to the second terminal 200 withouta request made by the second terminal 200.

Third Embodiment

In the second embodiment of the present invention, while a user of thesecond terminal 200 is using screen information containing firstnotification information, if such an event as a call, a messagereception and the like occurs in a first terminal 100, a screencontaining the first notification information may be switched to ascreen of the event occurring in the first terminal 100 irrespective ofintention of the user of the second terminal 200.

To overcome such an inconvenience of the second embodiment, according toa third embodiment of the present invention, while a user of a secondterminal 200 is using the screen information, if an event occurs in afirst terminal 100, the occurrence of the event of the first terminal100 is indicated on a screen of the second terminal 200 using secondnotification information notifying the even occurrence. After the userof the second terminal 200 has completed the use of the screeninformation, an event relevant screen can be displayed.

An operation process according to a third embodiment of the presentinvention is explained in detail with reference to FIG. 22 as follows.

FIG. 22 is a signal processing diagram for a data transceiving processbetween a first terminal and a second terminal according to a thirdembodiment of the present invention.

Referring to FIG. 22, an operation process including steps S114 to S117is identical to that shown in FIG. 19.

If a specific event occurs in the first terminal 100 [S118], thecontroller 180 of the first terminal 100 generates second notificationinformation indicating the occurring event via the communication unit110, displays the generated second notification information on a currentscreen, and then transmits the generated second notification informationto the second terminal 200, instead of transmitting screen informationcorresponding to the occurring event to the second terminal 200 [S119].In this case, the event can include one of a call, a message reception,an alarm output and the like.

Moreover, the second notification information can be generated as one ofa text, an image, an icon, an animation, a watermark and a barcode toindicate the occurring event.

Meanwhile, the controller 270 of the second terminal 200 displays thesecond notification information received from the first terminal 100 onthe screen having the first notification information contained therein[S120].

In this case, the controller 270 of the second terminal 200 can displaythe second notification information by having the second notificationinformation synthesized within or overlapped with the screen having thefirst notification information contained therein.

Moreover, the controller 270 of the second terminal 200 is able todisplay the second notification information within an indicator regionof the screen containing the first notification information therein.

In this case, if a user of the second terminal 200 selects the secondnotification information by manipulating the input unit 220 [S121], thecontroller 270 generates a signal for requesting an event relevantscreen corresponding to the selected second notification information andthen transmits the generated event relevant screen request signal to thefirst terminal 100 via the communication unit 210 [S122].

In this case, location information of the second notificationinformation located on the screen is included in the event relevantscreen request signal.

In particular, the controller 270 obtains the location of the selectedsecond notification information at the screen and then transmits arequest signal containing the obtained location information of thesecond notification information to the first terminal 100.

Subsequently, if the event relevant screen request signal is receivedfrom the second terminal 200, the controller 180 of the first terminal100 switches a current screen of the display module 151 to the occurringevent relevant screen and then transmits the event relevant screeninformation to the second terminal 200 [S123].

In particular, the controller 180 obtains location information of thesecond notification information included in the received request signal.If the second notification information exists at the obtained locationon the current screen, the controller 180 switches the current screen toan event screen corresponding to the second notification information andthen transmits the switched event screen information to the secondterminal 200.

In case of receiving the event relevant screen information from thefirst terminal 100, the controller 270 of the second terminal 200switches the screen containing the first notification information to thereceived event relevant screen [S124].

Moreover, if the event ends, the controller 180 of the first terminal100 transmits the screen information prior to the event occurrence tothe second terminal 200 via the communication unit 110. Subsequently,the second terminal 200 is able to return to the screen prior to theevent occurrence from the event relevant screen.

Operations of the steps S118 to S124 are explained in detail withreference to FIG. 23 and FIG. 24 as follows.

FIG. 23 and FIG. 24 are diagrams of screen configurations for explaininga process for generating and displaying second notification informationfor a first terminal to announce an event occurrence according to athird embodiment of the present invention.

First of all, (a) of FIG. 23 shows that an event occurring in the stepS118 is a call event 30.

If the call event 30 occurs, the controller 180 of the first terminal100 generates second notification information of an icon type 30 a toindicate the call event 30 and then transmits the generated secondnotification information of the icon type 30 a, as shown in (b) of FIG.23, to the second terminal 200.

While displaying the screen containing the first notificationinformation 10 a, the second terminal 200 displays the receivednotification information 30 a on the screen if the second notificationinformation 30 a indicating the call event 30 is received from the firstterminal 100.

In this case, if the second notification information 30 a is selectedvia the input unit 220, the controller 270 of the second terminal 200generates a signal for requesting a screen relevant to the call event 30corresponding to the second notification information 30 a and thentransmits the generated request signal to the first terminal 100 via thecommunication unit 210.

If the request signal is received from the second terminal 200, thecontroller 180 of the first terminal 100 switches a current screen ofthe display unit 151 to the screen relevant to the call event 30 andthen transmits screen information relevant to the call event 30 to thesecond terminal 200.

In case of receiving the screen information relevant to the call event30 via the communication unit 210, the controller 270 of the secondterminal 200 switches the screen containing the first notificationinformation 10 b displayed on the display unit 260, as shown in (b) ofFIG. 23, to the call event relevant screen 30 b, as shown in (c) of FIG.23.

And, (a) of FIG. 24 shows that the event occurring in the step S118 is amessage reception event 40.

If the message reception event 40 occurs, the controller 180 of thefirst terminal 100 generates second notification information of an icontype 40 a to indicate the message reception event 40 and is then able totransmit the generated second notification information of the icon type40 a, as shown in (b) of FIG. 24, to the second terminal 200.

While displaying the screen containing the first notificationinformation 20 a, if the second notification information 40 a indicatingthe message reception event 40 is received from the first terminal 100,the second terminal 200 displays the received notification information40 a on the screen containing the first notification information 20 a.

In this case, if the second notification information 40 a is selectedvia the input unit 220, the controller 270 of the second terminal 200generates a signal for requesting a screen relevant to the messagereception event 40 corresponding to the second notification information40 a and then transmits the generated message reception event relevantrequest signal to the first terminal 100 via the communication unit 210.

If the message reception event relevant screen request signal isreceived from the second terminal 200, the controller 180 of the firstterminal 100 switches a current screen of the display unit 151 to thescreen relevant to the message reception event 40 and then transmitsscreen information relevant to the message reception event 40 to thesecond terminal 200.

In case of receiving the screen information relevant to the messagereception event 40 via the communication unit 210, the controller 270 ofthe second terminal 200 switches the screen containing the firstnotification information 20 a displayed on the display unit 260, asshown in (b) of FIG. 24, to the message reception event relevant screen40 b, as shown in (c) of FIG. 24.

Fourth Embodiment

In case that a plurality of homogeneous or heterogeneous contentinformation exist within a screen of a first terminal 100, the object ofa fourth embodiment of the present invention is to provide a functionfor enabling a second terminal 200 to operate each of the contentinformation.

FIG. 25 is a signal processing diagram for a process for a secondterminal to access homogeneous content information of a first terminalaccording to a fourth embodiment of the present invention.

And, FIG. 26 is a diagram of a screen configuration of a process for asecond terminal to access homogeneous content information of a firstterminal according to a fourth embodiment of the present invention.

Referring to FIG. 25 and FIG. 26, if a first content information 51 aand a second content information 52 a, which are homogenous, existwithin a screen to display, the controller 180 of the first terminal 100generates a first notification information 51 b indicating thehomogenous first content information 51 a and a second notificationinformation 52 b indicating the homogenous second content information 52a and then transmits the generated first and second notificationinformation 51 b and 52 b to the second terminal 200 by having thegenerated first and second notification information 51 b and 52 bincluded in the screen information to display [S211] [(a) of FIG. 26].

In (a) of FIG. 26, shown is that the homogenous first and second contentinformation 51 a and 52 a are internet accessible webpage addresses.And, the first and second notification information 51 b and 52 bindicating the webpage addresses are shown as icons, respectively.

Yet, the present invention non-limits the types of the first and secondcontent information 51 a and 52 a and the shapes (or representation) ofthe first and second notification information 51 b and 52 b.

The controller 270 of the second terminal 200 displays the screeninformation containing the first and second notification information 51b and 52 b received from the first terminal 100 via the communicationunit 210 on the display unit 260 [S212] [(b) of FIG. 26].

If a user of the second terminal 200 selects the first notificationinformation 51 b from the first notification information 51 b and thesecond notification information 52 b [S213], the controller 270 of thesecond terminal 200 displays menus 53 a, 53 b, 53 c and 53 d forexecuting functions of the first content information 51 a correspondingto the selected first notification information 51 b, as shown in (c) ofFIG. 26, on the display unit 260 [S214].

If the first menu 53 a (‘e₁ access’) is selected from the menus 53 a, 53b, 53 c and 53 d shown in (c) of FIG. 26 [S215], the controller 270 ofthe second terminal 200 generates a signal for a function executionscreen request of the first content information 51 a corresponding tothe first menu 53 a (‘e₁ access’) and then transmits the generatedrequest signal to the first terminal 100 via the communication unit 210[S216].

Subsequently, the controller 180 of the first terminal 100 controls thecommunication unit 110 to access the first content information 51 a,i.e., a webpage address corresponding to ‘http://www.abc.com’ and thentransmits the screen information 54 of the accessed webpage to thesecond terminal 200 [S217]. If so, the controller 270 of the secondterminal 200 displays the webpage screen information 54 received fromthe first terminal 100 on the display unit 260 [S218].

While the webpage screen information 54 in the step S218 is beingdisplayed, if the second menu 53 b (‘e₁ access disconnect’) is selectedfrom the menus 53 a, 53 b, 53 c and 53 d shown in (c) of FIG. 26, thecontroller 270 of the second terminal 200 stops displaying the webpagescreen information 54 and is then able to switch to a current screen toa screen according to (b) of FIG. 26.

While the webpage screen information 54 in the step S218 is beingdisplayed, if the third menu 53 c (‘store’) is selected from the menus53 a, 53 b, 53 c and 53 d shown in (c) of FIG. 26, the controller 270 ofthe second terminal 200 is able to control the webpage screeninformation 54 to be stored as an image in the memory 240.

FIG. 27 is a signal processing diagram for a process for a secondterminal to access heterogeneous content information of a first terminalaccording to a fourth embodiment of the present invention.

FIG. 28 is a diagram of a screen configuration of a process for a secondterminal to access heterogeneous content information of a first terminalaccording to a fourth embodiment of the present invention.

Referring to FIG. 27 and FIG. 28, if first to third content information61 a, 62 a and 63 a, which are heterogeneous (i.e., different in kind),exist within a screen to display, the controller 180 of the firstterminal 100 generates first to third notification information 61 b, 62b and 63 b notifying the heterogeneous first to third contentinformation 61 a, 62 a and 63 a and then transmits them to the secondterminal 200 by having the generated first to third notificationinformation 61 b, 62 b and 63 b included in the screen information todisplay [S301] [(a) of FIG. 28].

In (a) of FIG. 28, shown is that the heterogeneous first contentinformation 61 a is an image file, the second content information 62 ais a document file, and the third content information 62 c is aphonebook. Moreover, the first to third notification information 61 b,62 b and 63 b respectively indicating the first to third contentinformation 61 a, 62 a and 63 a have icon shapes, respectively.

Yet, the present invention non-limits the types of the first to thirdcontent information 61 a, 62 a and 63 a and the shapes (orrepresentation) of the first to third notification information 61 b, 62b and 63 b.

The controller 270 of the second terminal 200 displays the screeninformation containing the first to third notification information 61 b,62 b and 63 b received from the first terminal 100 via the communicationunit 210 on the display unit 260 [S302] [(b) of FIG. 28].

In this case, the controller 270 of the second terminal 200 displaysmenus 64 for executing functions of the first to third contentinformation 61 a, 62 a and 63 a corresponding to the first to thirdnotification information 61 b, 62 b and 63 b, as shown in (b) of FIG.28, on the display unit 260 [S303].

If a user of the second terminal 200 selects the third menu 64 c (‘viewphonebook’) from the menus 64 [S304], the controller 270 of the secondterminal 200 generates a signal for requesting a function executionscreen of the third menu 64 c (‘view phonebook’) and then transmits thegenerated request signal to the first terminal 100 via the communicationunit 210 [S305].

Subsequently, the controller 180 of the first terminal 100 executes thethird content information 63 a, i.e., ‘phonebook’ and then transmits thescreen information 63 c of the executed phonebook 63 a to the secondterminal 200 [S306].

If so, the controller 270 of the second terminal 200 displays thephonebook screen information 63 c received from the first terminal 100on the display unit 260 [S307].

In this case, if the phonebook screen information 63 c in the step S307is displayed, the controller 270 of the second terminal 200 is able todisplay submenus 64 c ₁, 64 c ₂, 64 c ₃ and 64 c ₄ for the functionexecution of the ‘phonebook’, as shown in (c) of FIG. 28, on one regionof the phonebook screen information 63 c.

After the user of the second terminal 200 has selected contactinformation (‘1. TOM’) from the phonebook screen information 63 c, ifthe user of the second terminal 200 selects the first submenu 64 c ₁(‘call connect’) from the submenus 64 c ₁, 64 c ₂, 64 c ₃ and 64 c ₄,the controller 270 of the second terminal 200 generates a signal forindicating that the contact information (‘1. TOM’) and the first submenu64 c ₁ (‘call connect’) are selected and then transmits the generatedsignal to the first terminal 100 via the communication unit 210.

If so, the controller 180 of the first terminal 100 connects a call to aphone number of the selected contact information (‘1. TOM’) bycontrolling the communication unit 110 according to the signal receivedfrom the second terminal and then transmits the call connected statusscreen to the second terminal 200.

Moreover, after the user of the second terminal 200 has selected contactinformation (‘1. TOM’) from the phonebook screen information 63 c, ifthe user of the second terminal 200 selects the second submenu 64 c ₂(‘message send’) from the submenus 64 c ₁, 64 c ₂, 64 c ₃ and 64 c ₄,the controller 270 of the second terminal 200 generates a signal forindicating that the contact information (‘1. TOM’) and the secondsubmenu 64 c ₂ (‘message send’) are selected and then transmits thegenerated signal to the first terminal 100 via the communication unit210.

If so, the controller 180 of the first terminal 100 transmits an inputwindow for a message to be sent to the phone number of the selectedcontact information (‘1. TOM’) to the second terminal 200 by controllingthe communication unit 110 according to the signal received from thesecond terminal 200.

The second terminal 200 displays the message input window received fromthe first terminal 100 and then transmits a message content writtenthrough the message input window to the first terminal 100.

Subsequently, the controller 180 of first terminal 100 transmits themessage content received from the second terminal 200 to the selectedcontact information (‘1. TOM’).

Moreover, the second terminal 200 selects the third submenu 64 c ₃ orthe fourth submenu 64 c ₄ from the submenus 64 c ₁, 64 c ₂, 64 c ₃ and64 c ₄, and is then able to edit or delete phone numbers and the likewithin the corresponding phonebook.

Fifth Embodiment

The object of a fifth embodiment of the present invention is to providea function of automatically connecting a communication without aseparate user's manipulation when the communication is connected betweena first terminal and a second terminal.

In particular, a fifth embodiment of the present invention relates to aprocess for automatically connecting a communication in-between usingshort-range communication or RFID.

In the following description of a fifth embodiment of the presentinvention, assume that a first terminal is a mobile terminal type,assume that a second terminal is a PC type, and assume that the secondterminal automatically searches for the first terminal to connect a (orestablish) communication.

A process for automatically connecting a communication using short-rangecommunication according to the present invention is explained withreference to FIG. 29 and FIG. 30 as follows.

FIG. 29 is a flowchart of a process for a second terminal toautomatically connect a (or establish) communication with a firstterminal using a short-range communication according to a fifthembodiment of the present invention.

And, FIG. 30 is a diagram of a screen configuration of a process for asecond terminal to set a time period of searching for a first terminalperiodically according to a fifth embodiment of the present invention.

Referring to FIG. 29 and FIG. 30, if a user selects a function forautomatically searching for the first terminal 100 around the secondterminal 200 and connecting a communication, the controller 270 of thesecond terminal 200 displays an access authentication device informationlist 71 previously provided to the memory 230 on the display unit 260[S401] [(a) of FIG. 30].

In this case, the access authentication device information list 71refers to a device information list of external devices having beenconnected to the second terminal 200 for communications throughauthentication processes.

If the first terminal (TX0015) 100 to automatically access is selectedfrom the access authentication device information list 71 [S402] [(a) ofFIG. 30], the controller 270 of the second terminal 200 displays awindow 72 for setting a time period for searching for the selected firstterminal (TX0015) on the display unit [S403] [(b) of FIG. 30].

If a user sets up the time period (5 minutes) through the time periodsetting window 72 [S404] [(b) of FIG. 30], the controller 270 of thesecond terminal 200 attempts the search and access of the first terminal(TX0015) 100 by the set time period (5 minutes) by controlling thecommunication unit 210 [S405] [(c) of FIG. 30].

If the access to the first terminal (TX0015) 100 is successful [S406],the controller 270 of the second terminal 200 connects the communicationwith the first terminal (TX0015) 100. The controller 270 of the secondterminal 200 receives the screen information of the aforesaid first tofourth embodiments from the first terminal (TX0015) 100 and thendisplays the received screen information [S407].

On the contrary, if the access to the first terminal (TX0015) 100 fails,the controller 270 of the second terminal 200 stands by during the settime period and then tries the access again [S408].

FIG. 31 is a diagram of a screen configuration of a process for a secondterminal to reset a time period for searching for a first terminalperiodically according to a fifth embodiment of the present invention.

Referring to FIG. 31, if the communication with the first terminal(TX0015) 100 is connected by the process shown in FIG. 29 and FIG. 30,the second terminal 200 receives the screen information according to thefirst to third embodiments from the first terminal (TX0015) 100 and thendisplays the received screen information. Moreover, the second terminal200 displays notification information 73 indicating the time period setup in FIG. 29 and FIG. 30 on the screen information [(a) of FIG. 31].

If a user selects the notification information 73, the controller 270 ofthe second terminal 200 recognizes that it is to change the time periodset in FIG. 29 and FIG. 30 and then re-displays the time period settingwindow 72 shown in (b) of FIG. 30 [(b) of FIG. 31].

If the user changes the time period (10 minutes) via the time periodsetting window 72, the controller 270 of the second terminal 200 triesthe search and access of the first terminal (TX0015) 100 by the changedtime period (10 minutes) by controlling the communication unit 210 [(c)of FIG. 31].

FIG. 32 is a flowchart of a process for a second terminal toautomatically connect a (or establish) communication with a firstterminal using an RFID according to a fifth embodiment of the presentinvention.

And, FIG. 33 is a diagram of a screen configuration of a process for asecond terminal to automatically connect a (or establish) communicationwith a first terminal using an RFID according to a fifth embodiment ofthe present invention.

Referring to FIG. 32 and FIG. 33, the controller 270 of the secondterminal 200 drives the RFID reader 271 for the communication connectionwith the first terminal [S501] and then detects whether the firstterminal 100 having the RFID tag 182 attached thereto is located aroundthe second terminal 200 through the RFID reader 271 [S502].

If the first terminal 100 having the RFID tag 182 attached theretoexists around the second terminal 200, the controller 270 of the secondterminal 200 reads device information of the first terminal 100 storedin the RFID tag 182 through the RFID reader 271 [S503].

The controller 270 checks whether the device information of the firstterminal 100 read through the RFID reader 271 exists within the accessauthentication device information list stored in the memory 230 [S504].If the corresponding information exists in the list [S505], thecontroller 270 of the second terminal 200 connects the communicationwith the first terminal 100 using the read device information of thefirst terminal 100 [S506].

Sixth Embodiment

The object of a sixth embodiment of the present invention is to providea function of extending a use time of a terminal by preventingunnecessary power consumption. In particular, while a communication isconnected between a first terminal and a second terminal, if anoperational status of a screen, audio, key input or the like fails tovary for a preset period of time, the communication between the firstterminal and the second terminal is disconnected.

In the following description of a sixth embodiment of the presentinvention, assume that a first terminal is a mobile terminal type,assume that a second terminal is a PC type, and assume that the secondterminal automatically searches for the first terminal to connect a (orestablish) communication.

A process for a second terminal to perform a disconnecting/re-connectingoperation of a communication with on a first terminal is explained withreference to FIGS. 34 to 38 as follows.

FIG. 34 is a flowchart of a process for a second terminal to performdisconnection and reconnection operations of communications with a firstterminal according to a sixth embodiment of the present invention.

FIG. 35 is a diagram of a screen configuration of a process for a secondterminal to perform disconnection and reconnection of communicationswith a first terminal according to a sixth embodiment of the presentinvention.

FIG. 36 is a diagram of a screen configuration of a process for a secondterminal to perform disconnection of a communication with a firstterminal according to a sixth embodiment of the present invention.

And, FIG. 37 and FIG. 38 are diagrams of screen configurations for aprocess for a second terminal to inform a user of disconnected andreconnected statuses of communications with a first terminal accordingto a sixth embodiment of the present invention.

Referring to FIGS. 34 to 38, if a communication is connected to thefirst terminal 100 according to the aforesaid fourth embodiment [S601],the controller 270 of the second terminal 200 receives data containingscreen information 510 from the first terminal via the communicationunit 210 and then displays the received screen information 510 on ascreen of the display unit 260 [S602] [(a) of FIG. 35].

In this case, the data received from the first terminal 100 can containaudio information and a key signal having been inputted to the firstterminal 100 as well as the screen information 510.

Subsequently, the controller 270 of the second terminal 200 detectswhether an operational state of the second terminal 200 is changedduring a preset duration [S603].

In particular, the controller 270 of the second terminal 200 detectswhether the operational state of the second terminal 200 maintains aninactive state.

In this case, the inactive state refers to a state in which the secondterminal 200 fails to receive new screen information or new audioinformation from the first terminal 100 or a state in which the secondterminal 200 does not transmit a key signal for remotely controlling anoperation of the first terminal 100 to the first terminal 100.

And, the duration for detecting the operational state change isvariously settable by a user. In particular, the controller 270 providesa user with a variously settable menu of the preset duration. The useris then able to change the duration through this menu.

Meanwhile, if the operational state of the second terminal 200 is notchanged for the preset duration [S604], the controller 270 recognizesthat the user does not use the remote control communication with thefirst terminal 100 according to the present invention and thendisconnects the communication with the first terminal 100 by controllingthe communication unit 210 [S605] [(b) of FIG. 35].

In particular, if new screen information or new audio information is notreceived from the first terminal 100 for the preset duration or a keysignal for controlling the operation of the first terminal 100 remotelyis not transmitted, the controller 270 disconnects the communicationwith the first terminal 100 by controlling the communication unit 210.

In this case, if the operational state of the second terminal 200 is notchanged for the preset duration, as shown in FIG. 36, the controller 270displays a selection window 82 for selecting a disconnection of acommunication with the first terminal 100 on the display unit 260 [(a)of FIG. 36]. If the disconnection of communication with the firstterminal 100 is selected from the selection window 82, the controller270 is able to disconnect the communication with the first terminal [(b)of FIG. 36].

If the communication with the first terminal 100 is disconnected, asshown in (a) of FIG. 37, the controller 270 is able to output audio data82 for announcing the disconnected communication to the speaker 240.

If the communication with the first terminal 100 is disconnected, asshown in (a) of FIG. 38, the controller 270 is able to displaynotification information 85 for announcing the disconnectedcommunication on the screen of the display unit 260.

In this case, if a user selects the notification information 85, asshown in (a) of FIG. 38, the controller 270 is able to reconnect thecommunication with the first terminal 100 by controlling thecommunication unit 210, as shown in (b) of FIG. 38.

If the communication with the first terminal 100 is disconnected, theuser is unable to remotely control the first terminal 100. Hence, inorder to save the power of the second terminal 200, the controller 270reduces screen brightness of the display unit 260 into a level lowerthan a preset brightness level or is able to turn off the display unit260.

Meanwhile, while the communication with the first terminal 100 isdisconnected, the controller 270 redetects whether the operational stateof the second terminal 200 is changed [S606].

While the communication with the first terminal 100 is disconnected, ifthe operational state of the second terminal 200 is changed [S607], thecontroller 270 reconnects the communication with the first terminal 100by making a request for a communication reconnection to the firstterminal 100 via the communication unit 210 [S608] [(c) of FIG. 35].

In particular, while the communication with the first terminal 100 isdisconnected, if new screen information or new audio information isreceived from the first terminal 100 or a key signal for controlling theoperation of the first terminal 100 remotely is transmitted, thecontroller 270 reconnects the communication with the first terminal 100by controlling the communication unit 210.

In this case, referring to (b) of FIG. 37, if the communication with thefirst terminal 100 is reconnected, the controller is able to outputaudio data 84 for announcing the reconnected communication to thespeaker 240.

If the communication with the first terminal 100 is reconnected, asshown in (b) of FIG. 38, the controller 270 is able to displaynotification information 86 for announcing the reconnected communicationon the screen of the display unit 260.

If the communication with the first terminal 100 is reconnected, thecontroller 270 drives the display unit 260 or reconstructs the reducedscreen brightness of the display unit 260 into an initial brightnesslevel.

FIG. 39 is a flowchart of a process for a first terminal to performdisconnection and reconnection operations of communications with asecond terminal according to a sixth embodiment of the presentinvention.

Referring to FIG. 39, if a communication with the second terminal 200 isconnected [S701], the controller 180 of the first terminal 100 transmitsdata containing screen information to the second terminal 200 via thecommunication unit 110 [S702].

If the communication is connected between the first terminal 100 and thesecond terminal 200, a display screen of the display unit 100 of thefirst terminal 100 is identical to that of the display unit 250 of thesecond terminal 200. And, a user of the first terminal 100 views thedisplay screen of the first terminal 100 via the screen of the displayunit 260 of the second terminal 200.

Hence, according to the sixth embodiment of the present invention, inorder to prevent the unnecessary consumption of the power of the firstterminal 100, if the communication with the second terminal 200 isconnected, the controller 180 of the first terminal 100 reduces a screenbrightness of the display unit 151 into a level lower than a presetbrightness level or is able to turn off the display unit 151.

Moreover, according to the sixth embodiment of the present invention, inorder to prevent the unnecessary consumption of the power of the firstterminal 100, if the communication with the second terminal 200 isconnected, the controller 180 of the first terminal 100 reduces abrightness of a backlight, which applies light to the user input unit130, into a level lower than a preset brightness level or is able toturn off the backlight.

Meanwhile, the controller 180 detects whether an operational state ofthe first terminal 100 is changed for (or during) a preset duration[S703].

In particular, the controller 180 of the first terminal 100 detectswhether the operational state of the first terminal 100 maintains aninactive state.

In this case, the inactive state refers to a state in which the firstterminal 100 fails to transmit new screen information or new audioinformation to the second terminal 200 or a state in which the firstterminal 100 does not receive a key signal for remotely controlling awireless communication operation of the first terminal 100 from thesecond terminal 200.

And, the duration for detecting the operational state change isvariously settable by a user. In particular, the controller 180 providesa user with a variously settable menu of the preset duration. The useris then able to change the duration through this menu.

Meanwhile, if the operational state of the first terminal 100 is notchanged for (or during) the preset duration [S704], the controller 180recognizes that the user does not use the wireless remote controlcommunication with the second terminal 200 according to the presentinvention and then disconnects the communication with the secondterminal 200 by controlling the communication unit 110 [S705].

In this case, if the operational state of the first terminal 100 is notchanged for the preset duration, as shown in FIG. 36, the controller 180displays a selection window for selecting a disconnection of acommunication with the second terminal 200 on the display unit 151. Ifthe disconnection of the communication with the second terminal 200 isselected from the selection window, the controller 180 is able todisconnect the communication with the second terminal.

If the communication with the second terminal 200 is disconnected, asshown in (a) of FIG. 37, the controller 180 is able to output audio datafor announcing the disconnected communication to the audio output module152.

If the communication with the second terminal 200 is disconnected, asshown in (a) of FIG. 38, the controller 180 is able to displaynotification information for announcing the disconnected communicationon the screen of the display unit 151.

In this case, if a user selects the notification information forannouncing the disconnected communication with the second terminal 200,as shown in (b) of FIG. 38, the controller 180 is able to reconnect thecommunication with the second terminal 200 by controlling thecommunication unit 110.

Meanwhile, while the communication with the second terminal 200 isdisconnected, the controller 180 redetects whether the operational stateof the first terminal 100 is changed [S706].

In particular, the controller 180 detects whether a key signal forcontrolling the operation of the first terminal 100 is received form thesecond terminal 200 or whether to transmit new screen or audioinformation to the second terminal 200.

While the communication with the second terminal 200 is disconnected, ifthe operational state of the first terminal 100 is changed [S707], thecontroller 180 reconnects the communication with the second terminal 200by controlling the communication unit 110 [S708].

In particular, the controller 180 reconnects the communication using thedevice information corresponding to the second terminal 200 in theaccess authentication device information list provided to the memory160.

Meanwhile, referring to (b) of FIG. 37, if the communication with thesecond terminal 200 is reconnected, the controller 180 is able to outputaudio data for announcing the reconnected communication to the audiooutput module 152.

If the communication with the second terminal 200 is reconnected, asshown in (b) of FIG. 38, the controller 180 is able to displaynotification information for announcing the reconnected communication onthe screen of the display unit 151.

If the communication with the second terminal 200 is reconnected, thecontroller 180 drives the display unit 151 or the backlight unit or isable to restore the reduced display brightness of the display unit 260or the brightness of the backlight unit into the initial brightnesslevel.

Seventh Embodiment

While a communication is connected between a first terminal and a secondterminal, the object of a seventh embodiment of the present invention isto provide a function of transceiving content information contained ineach screen of the first and second terminals between the first terminaland the second terminal and a function of storing, executing and editingthe received content information.

In the following description of a seventh embodiment of the presentinvention, assume that a first terminal is a mobile terminal type andassume that a second terminal is a PC type.

A seventh embodiment of the present invention is explained in detailwith reference to FIGS. 40 to 55 as follows.

First of all, referring to FIGS. 40 to 52, if a communication with thefirst terminal 100 is connected via the communication unit 210 [S801],the controller 270 of the second terminal 200 receives screeninformation containing at least one content information therein from thefirst terminal 100 and then displays the received screen information ofthe first terminal on a screen 600 of the display unit 260 [S802].

In this case, the controller 270 of the second terminal 200 divides thescreen 600 of the display unit 260, as shown in (a) of FIG. 41, into afirst region 610 and a second region 620. Subsequently, the controller270 of the second terminal 200 displays the first screen informationcontaining the content information 611, 612 and 613 of the firstterminal 100 on the first region 610 and also displays the second screeninformation containing the content information 625 of the secondterminal 200 on the second region 620.

Referring to (b) and (c) of FIG. 41, the controller 270 of the secondterminal 200 is able to display the first region 610 to have the sameshape of an exterior of the first terminal 100 with a size of the screenof the mobile terminal 100.

In (b) of FIG. 41, shown is that the first terminal 100 is a touchscreentype terminal. In (c) of FIG. 41, shown is that the first terminal 100is a bar type terminal having a character input key.

Meanwhile, while the first and second screen information are displayedon the first and second regions 610 and 620, respectively, if a userselects at least one of the content information within the first region610 via the input unit 220 or the display unit 260 of a touchscreen type[S803], the controller 270 of the second terminal 200 generates a signalfor making a request for the selected content information to the firstterminal 100 and then transmits the generated request signal to thefirst terminal 100 via the communication unit 210.

In this case, if the first terminal 100 is the touchscreen type shown in(b) of FIG. 41, as proposed in the foregoing descriptions with referenceto FIG. 4 and FIG. 5, the controller 270 of the second terminal 200 isable to transmit the content information request signal to the firstterminal 100 in a manner that location information of the selectedcontent information in the screen is contained in the contentinformation request signal.

If the first terminal 100 is the bar type shown in (c) of FIG. 32, thecontroller 270 of the second terminal 200 enables a key value, which wasinputted by a user for the selection of the content information, to becontained in the content information request signal.

In particular, if the content information within the first region 610 isselected, the controller 270 checks a display location of the contentinformation within the first region 610 and then transmits a requestsignal containing the checked location information to the first terminal100.

The controller 180 of the first terminal 100 obtains the locationinformation within the request signal received from the second terminal200 and then transmits the content information located at the obtainedlocation on a current screen to the second terminal 200.

Finally, the controller 270 of the second terminal 200 receives therequested content information from the first terminal 100 via thecommunication unit 210 [S805].

A process for selecting the content information in the step S803 isexplained in detail with reference to FIGS. 42 to 46 as follows.

First of all, referring to FIG. 42, if content information (‘a.jpg’) 612to be downloaded from the first terminal 100 is dragged and dropped tothe second region 620 from the first region 610 via a keypad or mouse ofthe input unit 220 or the touchscreen 260 [(a) of FIG. 42], thecontroller 270 makes a request for the content information (‘a.jpg’) 612to the first terminal 100 and then receives the requested contentinformation (‘a.jpg’) 612 from the first terminal 100 [(b) of FIG. 42].

In particular, after a user of the second terminal 200 has placed apointer provided to the screen 600 at the content information (‘a.jpg’)612 within the first region 610 by manipulating the keypad or mouse ofthe input unit 220 or the like, if the content information (‘a.jpg’) 612is dragged & dropped into the second region 620, the controller 270makes a request for the content information (‘a.jpg’) 612 to the firstterminal 100 and then receives it from the first terminal 100.

In more particular, if the content information (‘a.jpg’) 612 is dragged& dropped into the second region from the first region 610, thecontroller 270 recognizes that the content information (‘a.jpg’) 612 hasbeen selected. The controller 270 then transmits the request signal tothe first terminal 100 in a manner that the display location informationof the content information (‘a.jpg’) 612 within the first region 610 iscontained in the request signal.

If the first terminal 100 receives the request signal containing thedisplay location of the content information (‘a.jpg’) 612 from thesecond terminal 200, it transmits the content information (‘a.jpg’) 612existing at the received location on the current screen to the secondterminal 200.

Subsequently, referring to FIG. 43, If the content information (‘a.jpg’)612 is selected, the controller 270 displays a first window 631 for atransmission request for the content information (‘a.jpg’) 612, a secondwindow 632 for an editing request and a third window 633 for anexecution request [(a) of FIG. 43].

In this case, if the first window 631 for the transmission command ofthe content information (‘a.jpg’) 612 is selected by a user, thecontroller 270 makes a request for the content information (‘a.jpg’) 612to the first terminal 100 and then receives the requested contentinformation (‘a.jpg’) 612 from the first terminal 100 [(b) of FIG. 43].

In (a) of FIG. 43, if the user selects the second window 632, thecontroller 270 transmits a signal for an editing request for the contentinformation (‘a.jpg’) 612 to the first terminal 100.

The controller 180 of the first terminal 100 drives an editingapplication of the content information (‘a.jpg’) 612, as shown in (a) ofFIG. 44, according to the editing request signal received from thesecond terminal 200 and then transmits the screen information shown in(a) of FIG. 44 to the second terminal 200.

The controller 270 of the second terminal 200 displays the screeninformation shown in (a) of FIG. 44 on the first region 610. If acommand for editing the content information (‘a.jpg’) 612 is inputted bya user via the input unit 220, the controller 270 of the second terminal200 transmits the editing command inputted from the input unit 220 tothe first terminal 100.

Subsequently, the controller 180 of the first terminal 100 edits thecontent information (‘a.jpg’) 612 according to the editing commandreceived from the second terminal 200 and then transmits the screeninformation, in which the content information (‘a.jpg’) 612 is edited.To the second terminal 200.

Meanwhile, the controller 270 of the second terminal 200 receives thescreen information, in which the content information (‘a.jpg’) 612 hasbeen edited, from the first terminal 100 and then displays the receivedscreen information on the first region 610. If the content information(‘a.jpg’) 612 edited by the user is dragged & dropped to the secondregion 620 from the first region 610, the controller 270 of the secondterminal 200 makes a request for the edited content information(‘a.jpg’) 612 to the first terminal 100 and is then able to receive therequested content information (‘a.jpg’) 612 from the first terminal 100.

In particular, in FIG. 44, the user of the second terminal 200 directlyedits data to download in the first terminal 100 and is then able todownload the edited data from the first terminal 100.

The controller 180 of the first terminal 100 drives an editingapplication of the content information (‘a.jpg’) 612, as shown in (a) ofFIG. 44, according to the editing request signal received from thesecond terminal 200 and then transmits the screen information shown in(a) of FIG. 44 to the second terminal 200.

The controller 270 of the second terminal 200 displays the screeninformation shown in (a) of FIG. 44 on the first region 610. If acommand for editing the content information (‘a.jpg’) 612 is inputted bythe user via the input unit 220, the controller 270 of the secondterminal 200 transmits the editing command inputted from the input unit220 to the first terminal 100.

The controller 180 of the first terminal 100 edits the contentinformation (‘a.jpg’) 612 according to the editing command received fromthe second terminal 200 and then transmits the screen information, inwhich the content information (‘a.jpg’) 612 has been edited, to thesecond terminal 200.

The controller 270 of the second terminal 200 receives the screeninformation, in which the content information (‘a.jpg’) 612 has beenedited, from the first terminal 100 and then displays the receivedscreen information on the first region 610. If the content information(‘a.jpg’) 612 is dragged & dropped to the second region 620 from thefirst region 610 by the user, the controller 270 of the second terminal200 makes a request for the edited content information (‘a.jpg’) 612 tothe first terminal 100 and is then able to receive the requested contentinformation (‘a.jpg’) 612,

Subsequently, referring to FIG. 45, after the user of the secondterminal 200 has made a selection 634 for the content information(‘a.jpg’) 612, which is to be downloaded from the first terminal 100, bymanipulating a keypad or mouse of the input unit 220, if the userselects a specific point 626 of the second region 620 [(a) of FIG. 45],the controller 270 makes a request for the content information (‘a.jpg’)612 to the first terminal 100 and then receives the requested contentinformation (‘a.jpg’) 612 [(b) of FIG. 45].

Subsequently, referring to FIG. 46, if the user of the second terminal200 specifies text content information 614, which is to be downloaded,within the first region 610 by manipulating a keypad or mouse of theinput unit 220 [(a) of FIG. 46], the controller 270 makes a request forthe specified text content information 614 to the first terminal 100 andthen receives the requested text content information 614 [(b) of FIG.46].

Meanwhile, the controller 270 is able to further perform a process forstoring, editing and executing the content information received from thefirst terminal, as shown in the following steps S806 to S811 or FIGS. 47to 52.

First of all, referring to FIG. 47, if a storage command for the contentinformation (‘a.jpg’) 612 received in (b) of FIG. 42 is inputted by auser [S806], the controller 270 stores the received content information(‘a.jpg’) 612 in the memory 240.

In this case, the controller 270 obtains a format of the contentinformation (‘a.jpg’) 612 and is then able to store the contentinformation (‘a.jpg’) 612 in an ‘image’ storage space 623 correspondingto the obtained format of the content information (‘a.jpg’) 612 amongstorage spaces 621, 622, 623 and 624 which have been already classifiedper content information format [S807].

Subsequently, if an editing command for the content information(‘a.jpg’) 612 received in (b) of FIG. 42 is inputted by a user [S808],the controller 270 drives an image editing relevant application 650previously provided to the memory 240, as shown in FIG. 48.

In this case, the editing application 650 is provided with a pluralityof editing tools for editing the image in various ways. The user of thesecond terminal 200 is able to edit the content information (‘a.jpg’)612 using the editing tools.

Moreover, the controller 270 is able to store the content information(‘a.jpg’) 612 having been edited by the user through the above editingtools [S809].

Subsequently, referring to FIG. 49, if an execution command for thecontent information (‘a.jpg’) 612 received in (b) of FIG. 42 is inputtedby a user [S810], the controller 270 drives an image execution relevantapplication 660 previously provided to the memory 240 and then executesthe content information (‘a.jpg’) 612 through the image executionapplication 660 [S811].

In this case, the image execution application 660 can include the imageviewer software that displays images in various formats and is able toperform the same editing function of the image editing application 650shown in FIG. 48.

Namely, it is able to display the content information (‘a.jpg’) 612through the image execution application. And, it is also able to editand store the content information (‘a.jpg’) 612.

Subsequently, referring to FIG. 50, while an email address list contentinformation 615 is displayed on the first region 610, if an emailaddress (‘2. KIM@abc.com’) 615 b is dragged & dropped to the secondregion 620 [(a) of FIG. 50], the controller 270 makes a request for theemail address (‘2. KIM@abc.com’) 615 b to the first terminal 100 andthen receives the requested email address (‘2. KIM@abc.com’) 615 b [(b)of FIG. 50].

If the email address (‘2. KIM@abc.com’) 615 b is selected, thecontroller 270 drives an email application relevant to the email address(‘2. KIM@abc.com’) 615 b and is then able to display an email writingwindow 670 for an email supposed to be sent to the email address (‘2.KIM@abc.com’) 615 b [(b) of FIG. 50]. In this case, if a user of thesecond terminal 200 writes an email content through the email writingwindow 660, the controller 270 is able to send the written email to theemail address (‘2. KIMabc.com’) 615 b.

Subsequently, referring to FIG. 51, while a phonebook contentinformation 616 is displayed on the first region 610, if a contactinformation (‘2. KIM 010-111-xxx’) 616 b is dragged & dropped to thesecond region 620 [(a) of FIG. 51], the controller 270 makes a requestfor the contact information (‘2. KIM 010-111-xxx’) 616 b to the firstterminal and then receives the requested contact information (‘2. KIM010-111-xxx’) 616 b [(b) of FIG. 51].

If the contact information (‘2. KIM 010-111-xxx’) 616 b is selected, thecontroller 270 drives a call connection application relevant to thecontact information (‘2. KIM 010-111-xxx’) 616 b and is then able toconnect a call to the contact information (‘2. KIM 010-111-xxx’) 616 b[(c) of FIG. 51].

Moreover, although not shown in FIG. 51, if the contact information (‘2.KIM 010-111-xxx’) 616 b is selected, the controller 270 drives a messagetransmitting application relevant to the contact information (‘2. KIM010-111-xxx’) 616 b and is then able to display a message writing windowfor a message to be sent to the contact information (‘2. KIM010-111-xxx’) 616 b. In this case, if a user of the second terminal 200writes a message content through the message writing window, thecontroller 270 is able to send the written message to the contactinformation (‘2. KIM 010-111-xxx’) 616 b.

Subsequently, referring to FIG. 52, while a webpage address(‘http://www.abc.com’) 617 is displayed on the first region 610, if thewebpage address (‘http://www.abc.com’) 617 is dragged & dropped to thesecond region 620 [(a) of FIG. 52], the controller 270 makes a requestfor the webpage address (‘http://www.abc.com’) 617 to the first terminal110 and then receives the requested webpage address(‘http://www.abc.com’) 617 [(b) of FIG. 52].

If the webpage address (‘http://www.abc.com’) 617 is selected, thecontroller 270 drives the internet access application and then accessesthe webpage address (‘http://www.abc.com’) 617 [(c) of FIG. 52].

Moreover, although not shown in the drawing, if the content informationreceived from the first terminal 100 is ‘schedule information’, thecontroller 270 of the second terminal 200 drives a schedule managementapplication and is then able to update the schedule managementapplication by editing the received ‘schedule information’ into thedriven schedule management application. And, the controller 270 of thesecond terminal 200 is able to update the schedule managementapplication without editing the received ‘schedule information’ into thedriven schedule management application.

In particular, all kinds of applications for the execution and editingof content information received from the first terminal 100 can beprovided to the memory 230 of the second terminal 200. The controller270 of the second terminal 200 obtains a format of the contentinformation received from the first terminal 100, drives an applicationcorresponding to the obtained format of the content information, and isthen able to provide a user with the execution and editing functions.

Subsequently, referring to FIGS. 53 to 55, if a communication with thefirst terminal 100 is connected via the communication unit 210 [S901],the controller 270 of the second terminal 200 receives screeninformation containing at least one content information from the firstterminal 100 and then displays the received screen information 610 ofthe first terminal 100 on a screen 600 of the display unit 260 [S902].

In this case, the controller 270 of the second terminal 200 divides thescreen 600 of the display unit 260, as shown in (a) of FIG. 54, into afirst region 610 and a second region 620. Subsequently, the controller270 of the second terminal 200 displays the first screen informationcontaining the content information 611, 612 and 613 of the firstterminal 100 on the first region 610 and also displays the second screeninformation containing the content information 625 of the secondterminal 200 on the second region 620.

While the first and second screen information are displayed on the firstand second regions 610 and 620, respectively, if a user selects contentinformation (‘work document.xls’) 625 within the second region 620 viathe input unit 220 or the display unit 260 of a touchscreen type [S903],the controller 270 of the second terminal 200 transmits the contentinformation (‘work document.xls’) 625 to the first terminal 100 bycontrolling the communication unit 210 [S904].

In particular, referring to (a) of FIG. 54, if the content information(‘work document.xls’) 625, which is to be transmitted to the firstterminal 100, is dragged and dropped from the second region 620 to thefirst region 610 via a keypad or mouse of the input unit 220 or thetouchscreen 260 [(a) of FIG. 42], the controller 270 transmits thecontent information (‘work document.xls’) 625 to the first terminal 100.

In particular, after a user of the first terminal 100 has placed apointer provided to the screen 600 at the content information (‘workdocument.xls’) 625 within the second region 620 by manipulating thekeypad or mouse of the input unit 220 or the like, if the contentinformation (‘work document.xls’) 625 is dragged & dropped into thefirst region 610, the controller 270 transmits the content information(‘work document.xls’) 625 to the first terminal 100.

Moreover, while the content information (‘work document.xls’) 625 withinthe second region 620 of the touchscreen type display unit 260 istouched, if the user of the second terminal 200 drags and drops thecontent information (‘work document.xls’) 625 into the first region 610,the controller 270 transmits the content information (‘workdocument.xls’) 625 to the first terminal 100.

While the user of the second terminal 200 selects the contentinformation (‘work document.xls’) 625, if the user selects the firstregion 610 by manipulating the keypad and mouse of the input unit 220,the controller 270 transmits the content information (‘workdocument.xls’) 625 to the first terminal 100.

If the user of the second terminal multi-touches the content information(‘work document.xls’) 625 within the second region 620 of thetouchscreen type display unit 260 and the first region 610, the user ofthe second terminal 200 transmits the content information (‘workdocument.xls’) 625 to the first terminal 100.

Moreover, if the user of the second terminal 200 specifies textinformation 670, which is to be transmitted to the first terminal 100,within the second region 620 by manipulating the keypad and mouse of theinput unit 220, as shown in (a) of FIG. 55, the controller 270 transmitsthe content information (‘work document.xls’) 625 to the first terminal100, a shown in (b) of FIG. 55.

The first terminal is able to perform the storing, editing and executingprocesses described with reference to FIGS. 47 to 52 on the contentinformation (‘work document.xls’) 625 received from the second terminal200 according to FIGS. 53 to 55. And, the first terminal 100 is able totransmit the storage, editing and execution screen information to thesecond terminal 200.

Eighth Embodiment

According to an eighth embodiment of the present invention, while asecond terminal is connected to communicate with a plurality of firstand third terminals, when screen information of the first and thirdterminals are respectively displayed on a screen of the second terminal,if content information within the screen information of the firstterminal is shifted into the screen information of the third terminal,the second terminal delivers the content information of the firstterminal to the third terminal. Such a function is provided by theeighth embodiment of the present invention.

In the following description of an eighth embodiment of the presentinvention, assume that first and third terminals are mobile terminaltypes and assume that a second terminal is a PC type terminal.

Referring to FIGS. 56 to 58, if communications with first and thirdterminals 100 and 300 are connected via the communication unit 210[S1001], the controller 270 of the second terminal 200 receives screeninformation, each of which contains at least one content information,from the first and third terminals 100 and 300, respectively, and thendisplays the received screen information 710 and 730 of the first andthird terminals 100 and 300 on a screen 700 of the display unit 260[S1002].

In this case, referring to FIG. 57, the controller 270 of the secondterminal 200 divides the screen 700 of the display unit 260 into firstto third regions 710, 720 and 730. The controller 270 of the secondterminal 200 displays the first screen information containing thecontent information 711 and 712 on the first region 710. The controller270 of the second terminal 200 displays the second screen information ofthe second terminal 200 on the second region 720. And, the controller270 of the second terminal 200 displays the third screen informationcontaining the content information 731 and 732 on the third region 730.

Meanwhile, while the screen information of the first and secondterminals 100 and 300 are displayed on the first and third regions 710and 730, respectively, if a user selects the content information 712within the first region 710 and the third region 730 via the input unit220 or the display unit 260 of a touchscreen type [S1003], thecontroller 270 of the second terminal 200 delivers the selected contentinformation 712 of the first terminal 100 to the third terminal 300 bycontrolling the communication unit 210 [S1004].

The content information selecting process of the first terminal 100 inthe step S903 is explained in detail with reference to FIG. 58 asfollows.

First of all, referring to FIG. 58, if content information (‘a.jpg’) 712of the first terminal 100, which is to be delivered to the thirdterminal 300, is dragged & dropped to the third region 730 from thefirst region 710 via the keypad of the input unit 220, the mouse or thetouchscreen 260 [(a) of FIG. 58], the controller 270 delivers thecontent information (‘a.jpg’) 712 to the third terminal 300 [(b) of FIG.58].

In particular, if a user of the second terminal 200 places a pointerprovided to the screen 700 at the content information (‘a.jpg’) 712within the first region 710 by manipulating the keypad of the input unit220, the mouse or the like and then drags & drops the contentinformation (‘a.jpg’) 712 into the third region 730 [(a) of FIG. 58],the controller 270 delivers the content information (‘a.jpg’) 712 to thethird terminal 300 [(b) of FIG. 58].

If the user of the second terminal 200 selects the third region 730 bymanipulating the keypad and mouse of the input unit 200 while selectingthe content information (‘a.jpg’) 712, the controller 270 delivers thecontent information (‘a.jpg’) 712 to the third terminal 300.

If the user of the second terminal 200 multi-touches the contentinformation (‘a.jpg’) 712 within the first region 710 of the touchscreen260 and the third region 730, the controller 270 delivers the contentinformation (‘a.jpg’) 712 to the third terminal 300.

In case of delivering the content information 712 selected in FIG. 58 tothe third terminal 300, the controller 270 generates a signal forcommanding to transmit the content information 712 to the third terminal300 and then transmits the generated transmission command signal to thefirst terminal 100 via the communication unit 210.

If so, the first terminal 100 transmits the content information 712 tothe third terminal 300 according to the transmission command signalreceived from the second terminal 200.

In this case, as mentioned in the foregoing description with referenceto FIG. 4 and FIG. 5, if the content information 712 of the first region710 is selected in (a) of FIG. 58, the controller 270 obtains displaylocation information of the content information 712 on the first region710 and is then able to transmit the transmission command signal in amanner that the obtained location information of the content information712 is contained in the transmission command signal. If so, the firstterminal 100 is able to transmit the content information 712 existing atthe received location within a current screen to the third terminal 300.

Moreover, the controller 270 makes a request for the selected contentinformation 712 in FIG. 58 to the first terminal 100 and then receivesthe requested content information 712. The controller 270 is able todeliver the content information 712 received from the first terminal 100by transmitting the content information 712 to the third terminal.

Subsequently, referring to FIG. 59 and FIG. 60, if communications withfirst and third terminals 100 and 300 are connected via thecommunication unit 210 [S1101], the controller 270 of the secondterminal 200 receives screen information, each of which contains atleast one content information, from the first and third terminals 100and 300, respectively, and then displays the received screen information710 and 730 of the first and third terminals 100 and 300 on a screen 700of the display unit 260 [S1102].

Meanwhile, while the screen information of the first and secondterminals 100 and 300 are displayed on the first and third regions 710and 730, respectively, if a user selects the content information 731within the third region 730 and the first region 710 via the input unit220 or the display unit 260 of a touchscreen type [S1103], thecontroller 270 of the second terminal 200 delivers the selected contentinformation 731 of the third terminal 300 to the first terminal 100 bycontrolling the communication unit 210 [S1104].

In particular, referring to FIG. 60, if the content information(‘d.avi’) 731 of the third terminal 300, which is to be delivered to thefirst terminal 100, is dragged & dropped from the third region 730 tothe first region 710 via the keypad of the input unit 220, the mouse orthe touchscreen 260 [(a) of FIG. 60], the controller 270 delivers thecontent information (‘‘d.avi’) 731 to the first terminal 300 [(b) ofFIG. 60].

If the user of the second terminal 200 selects the first region 710 bymanipulating the keypad and mouse of the input unit 200 while selectingthe content information (‘d.avi’) 731, the controller 270 delivers thecontent information (‘d.avi’) 731 to the first terminal 100.

If the user of the second terminal 200 multi-touches the contentinformation (‘d.avi’) 731 within the third region 730 of the touchscreen260 and the first region 710, the controller 270 delivers the contentinformation (‘d.avi’) 731 to the first terminal 100.

Ninth Embodiment

According to a ninth embodiment of the present invention, while ashort-range communication for a wireless operation control of thepresent invention is connected between a first terminal and a secondterminal, if the first terminal is connected to a mobile communicationwith an external third terminal, the first terminal converts short-rangecommunication data received from the second terminal to mobilecommunication data and then transmits this mobile communication data tothe third terminal. Moreover, the first terminal converts mobilecommunication data received from the third terminal to short-rangecommunication data and then transmits this short-range communicationdata to the second terminal. Therefore, the object of the ninthembodiment of the present invention is to provide a tripartiteheterogeneous communication function.

In the following description of a ninth embodiment of the presentinvention, assume that first and third terminals are mobile terminaltypes and assume that a second terminal is a PC type terminal.

A ninth embodiment of the present invention is explained in detail withreference to FIG. 61 and FIG. 62 as follows.

FIG. 61 is a signal processing diagram of a process for performing avoice call among a second terminal, a first terminal and a thirdterminal using different communication systems according to a ninthembodiment of the present invention.

Referring to FIG. 61, If a remote control communication with the secondterminal 200 is connected [S1201], the controller 180 of the firstterminal 100 is able to perform the above-mentioned operations of thefirst to eighth embodiments. And, the controller 180 of the firstterminal 100 is able to perform a voice call with the second terminal200 using the short-range communication.

In particular, the controller 270 of the second terminal 200 converts auser audio inputted via the microphone to a short-range communicationaudio signal and then transmits the converted short-range communicationaudio signal to the first terminal 100 via the communication unit 210[S1202]. Moreover, the controller 270 of the second terminal 200 outputsa speech signal of the first terminal 100, which was received via thecommunication unit 210, to the speaker 240.

The controller 180 of the first terminal 100 converts a user audioinputted via the microphone 122 to a short-range communication audiosignal and then transmits the converted short-range communication audiosignal to the second terminal 200 via the communication unit 110[S1203]. Moreover, the controller 180 of the first terminal 100 outputsa speech signal of the second terminal 200, which was received via thecommunication unit 110, to the audio output module 152.

Thus, in the course of the voice call using the short-rangecommunication with the second terminal 200, if a mobile communicationwith an external third terminal 300 is connected [S1204], the controller180 of the first terminal 100 generates a signal for querying a presenceor non-presence of a communication connection to the third terminal 200and then transmits the generated query signal to the second terminal 200[S1205].

In this case, the mobile communication can adopt one of Code DivisionMultiple Access (CDMA), Universal Mobile Telecommunications Systems(UMTS), Global System for Mobile Communications (GSM) and Wideband CodeDivision Multiple Access (WCDMA).

If the query signal is received from the first terminal 100, thecontroller 270 of the second terminal 200 displays a selection windowfor selecting a presence or non-presence of a communication connectionwith the third terminal 200 on the screen of the display unit 260.

If an acceptance of a communication connection with the third terminal300 is selected from the selection window [S1206], the controller 27transmits a signal for announcing the communication connectionacceptance to the first terminal 100 and transmits a user's audio signalinputted via the microphone 250 to the first terminal 100 [S1207].

Moreover, if a communication disconnection from the third terminal 300is selected from the selection window, the controller 270 of the secondterminal 200 transmits a signal for announcing the communicationdisconnection to the first terminal 100.

If the signal for announcing the communication disconnection is receivedfrom the second terminal 200, the first terminal 100 disconnects thecommunication between the second terminal 200 and the third terminal 300[S1208].

Meanwhile, if the short-range communication audio signal is receivedfrom the second terminal 200 [S1207], the controller 180 of the firstterminal 100 converts the received short-range communication audiosignal to a mobile communication audio signal [S1209] and then transmitsthe converted mobile communication audio signal to the third terminal300 [S1210].

Moreover, if the mobile communication audio signal is received from thethird terminal 300 [S1211], the controller 180 of the first terminal 100converts the received mobile communication audio signal to a short-rangecommunication audio signal [S1212] and then transmits the convertedshort-range communication audio signal to the second terminal 200[S1213].

FIG. 62 is a signal processing diagram of a process for performing avoice call among a second terminal, a first terminal and a thirdterminal using messages and speech according to a ninth embodiment ofthe present invention.

Referring to FIG. 62, the first terminal 100 is connected to the secondterminal 200 by a short-range communication system [S1301] and is alsoconnected to the third terminal 300 by a mobile communication system[S1302].

In this case, the first terminal 100 performs a text messagecommunication with the second terminal using the short-rangecommunication system and also performs a speech call with the thirdterminal 300 using the mobile communication system.

The first terminal 100 transmits a signal for querying a presence ornon-presence of a communication connection with the third terminal tothe second terminal 200 [S1303].

If the query signal is received from the first terminal 100, the secondterminal 200 displays a selection window for selecting a presence ornon-presence of a communication connection with the third terminal 300on the screen of the display unit 260.

If an acceptance of a communication connection with the third terminal300 is selected from the selection window [S1304], the second terminal200 transmits a signal for announcing the acceptance of thecommunication connection to the first terminal 100, receives an input ofa message content from a user [S1305], and then sends a message inputtedby the user to the first terminal [S1306].

If a communication disconnection from the third terminal 300 is selectedfrom the selection window, the second terminal 200 transmits a signalfor announcing the communication disconnection to the first terminal100.

If the signal for announcing the communication disconnection is receivedfrom the second terminal 200, the first terminal 100 disconnects thecommunication between the second terminal 200 and the third terminal 300[S1307].

Meanwhile, if a short-range communication message is received from thesecond terminal 200 [S1306], the first terminal 100 converts the messagecontent to a mobile communication audio signal using the text to speechconverting unit 181 [S1308] and then transmits the converted mobilecommunication audio signal to the third terminal 300 [S1309].

In particular, the first terminal 100 converts the message content ofthe second terminal 200 to a speech call content and then transmits thespeech call content to the third terminal 300. Therefore, a user of thethird terminal 300 is able to make a speech call to the third terminal300 through the first terminal 100.

If the mobile communication audio signal is received from the thirdterminal 300 [S310], the first terminal 100 converts the received mobilecommunication audio signal to a short-range communication message usingthe text to speech converting unit 181 [S1311] and then sends theconverted short-range communication message to the second terminal 200[S1312].

In particular, the first terminal 100 converts the speech call contentof the third terminal 300 to a text message and then sends the textmessage to the second terminal 200. Therefore, a user of the secondterminal 200 is able to perform a message communication with the thirdterminal 300 through the first terminal 100.

Alternatively, although the first terminal 100 converts the message ofthe second terminal 200 to the mobile communication audio signal in thestep S1308, the second terminal 200 converts a message content writtenby a user to a mobile communication audio signal and is then able totransmit this mobile communication audio signal to the first terminal100.

Accordingly, the present invention provides the following effects and/oradvantages.

First of all, data of a first terminal is executable in a secondterminal. And, all functions of the first terminal are usable using thesecond terminal.

Secondly, content information contained in a first terminal screen canbe freely used by a second terminal.

Thirdly, a tripartite heterogeneous communication function can beprovided to first to third terminals using a short-range communicationsystem and a mobile communication system.

In addition, the above-described methods can be implemented in a programrecorded medium as computer-readable codes. The computer-readable mediainclude all kinds of recording devices in which data readable by acomputer system are stored. The computer-readable media include ROM,RAM, CD-ROM, magnetic tapes, floppy discs, optical data storage devices,and the like for example and also include carrier-wave typeimplementations (e.g., transmission via Internet).

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A method of controlling a display device, the method comprising: establishing communication between an external mobile device and the display device to receive screen information displayed on the external mobile device; displaying the screen information displayed in the external mobile device in a first region of a screen of the display device, wherein the screen information includes a first image corresponding to a first file stored in the external mobile device and a virtual manipulation unit corresponding to a physical manipulation unit provided at a main body of the external mobile device; displaying a second image corresponding to a second file stored in the display device or another device connected to the display device in a second region of the screen of the display device, wherein the first region and the second region are displayed together on the screen of the display device; in response to receiving a first drag input starting on the first image in the first region and ending at a location within the second region, storing the first file in the display device or the another device and displaying a third image corresponding to the first file in the second region, wherein the first image in the first region has a different appearance than the third image in the second region; in response to receiving a second drag input starting on the second image in the second region and ending at a location within the first region, transmitting the second file to the external mobile device; and in response to a user input on the virtual manipulation unit in the first region, transmitting a signal from the display device to the external mobile terminal for controlling the external mobile terminal.
 2. The method of claim 1, wherein the establishing communication between the external device and the display device further comprises searching for the external device.
 3. The method of claim 2, wherein the display device transmits an access request to the external device searched for establishing communication.
 4. The method of claim 1, wherein the virtual manipulation unit corresponds to a model of the external device.
 5. A non-transitory computer readable storage medium having a processing program stored thereon, wherein the processing program is configured to cause a processor of a display device to perform: establishing communication between an external mobile device and the display device to receive screen information displayed on the external mobile device; displaying the screen information displayed in the external mobile device in a first region of a screen of the display device, wherein the screen information includes a first image corresponding to a first file stored in the external mobile device and a virtual manipulation unit corresponding to a physical manipulation unit provided at a main body of the external mobile device; displaying a second image corresponding to a second file stored in the display device or another device connected to the display device in a second region of the screen of the display device, wherein the first region and the second region are displayed together on the screen of the display device; in response to receiving a first drag input starting on the first image in the first region and ending at a location within the second region, storing the first file in the display device or the another device and displaying a third image corresponding to the first file in the second region, wherein the first image in the first region has a different appearance than the third image in the second region; in response to receiving a second drag input starting on the second image in the second region and ending at a location within the first region, transmitting the second file to the external mobile device; and in response to a user input on the virtual manipulation unit in the first region, transmitting a signal from the display device to the external mobile terminal for controlling the external mobile terminal.
 6. The non-transitory computer readable storage medium of claim 5, wherein the establishing communication between the external device and the display device further comprises searching for the external device.
 7. The non-transitory computer readable storage medium of claim 6, wherein the display device transmits an access request to the external device searched for establishing communication.
 8. The non-transitory computer readable storage medium of claim 5, wherein the virtual manipulation unit corresponds to a model of the external device.
 9. A display device comprising: a communication unit configured to establish communication between an external mobile device and the display device; and a controller configured to: receive screen information displayed on the external mobile device, display the screen information displayed in the external mobile device in a first region of a screen of the display device, wherein the screen information includes a first image corresponding to a first file stored in the external mobile device and a virtual manipulation unit corresponding to a physical manipulation unit provided at a main body of the external mobile device, display a second image corresponding to a second file stored in the display device or another device connected to the display device in a second region of the screen of the display device, wherein the first region is spaced apart from the second region on the screen of the display device, in response to receiving a first drag input starting on the first image in the first region and ending at a location within the second region, store the first file in the display device or the another device and display a third image corresponding to the first file in the second region, wherein the first image in the first region has a different appearance than the third image in the second region; in response to receiving a second drag input starting on the second image in the second region and ending at a location within the first region, transmit the second file in the external mobile device; and in response to a user input on the virtual manipulation unit in the first region, transmit a signal from the display device the external mobile terminal for controlling the external mobile terminal. 